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ABSTRACT 

, REPLACING- JOBS WITH TASK CLUSTERS 
AS THE WORK UNIT FOR TEST VALIDATJON 

Brent fiaxter 

^ Statement of the Problem • " ' 

*The amount of research effort and cost to^ collect evidence that a personnel 
test is an efficient and fair predictor of performance on a particular job for 
all classes of applicants can be considerable. When this burden is extended 
to all the .jobs for which the test might be relevant (as required by EEOC Gujde- 
lines), the cost becomes exorbitant. ^The pres^j>t--pi4)ject sought an alternative^ 
less costly approach which would still maintain high standards and job rele- 
vancy. The alternative is to predict performance on major job functions (task 
clusters) rather than the entire job. This approach assumes that the same 
basic functions appear across manyL jobs. The, purpose of the project was to 
identify such functions and demonstrate their: application to a validity study. 

Development of a Task Structure 

Using a large number of tasks ♦from clerical/technical/administrative jobs, 
a basix system of task clusters was found which describes the inherent nature/ 
of the Information processing being performed. Each cluster describes: 1) 
how the*worker obtains the information which is processed.; 2) what manipula- 
tions are performed ^nd their complexit^r; and 3) hpw the worker provides some 
form of task output. In the most typical task the worker 1) deals with infor-^' 
mation that comes to the v/ork setting ready for manipulation (a search for in- 
formation is not necQSsary), 2) sorts^ files or compiUs the infonjiation fol- 
lowi;ig simple, well-defined rules, and 3) provides a standard written output. 

Study Design <v ' 

,A demonstration, study was designed to validate the ability of the U.S.E.S. 
Basic Occupational Literacy Test (BOLT) to predict performance on 10 basic task 
clusters. The task clusters selected were relatively easy and represented work 
frequently appearing in entry level positions. They were prototypes for' re- 
presentative, realH7orld tasks. Methods of measuring task cluster output were 
devised to provide criteria* These measures were demonstrated' to be objective . 
and reliable indites of performance. • 



The BOLT Test .and measures of performance were administered by^tate 
Employment Service persq|inel to over 2.000,Whites. Blacks, American Indians, 
and'Spanish background vjolunteers from 12 States. These groups, including a 
barl^nce of mates and fejrales, Had minimum English language- literacy skills j- 
.They covered an age range from 16 to 69. • , • • 

Separate data analysis evaluated the predictiveness of each of th^ four 
BOLT subtests (Arithmetic Computation, Arithmetic Reasoning, Reading Vocabu- 
lary, and Reading Comprehension) within each of the racial/ethnic and sex 
groups. The analysis also considered whether or not a single prediction 
equation was fair for all groups. The data review went Ifeyond the sunmary 
statistics to an .examination of the ^atterplots, thus revealing ijnilore'de'", 
'tail ,the particular nature of the're^lationsfrips. - 

Study Results , 

The results showed ^hat one or more of the BOLT subtests predicted perfor- 
mance on all the typical tasks, and in almost every case for each' of the sub- 
groups. The Arithmetic Computation Test proved to be the most effective pre- 
dictor. 

Thp validity- coefficients did not differ significantly among the racial/ 
ethnic groups nor between the sexes. The lowest literacy Blacks, and f-lales, 
however^ tended to have considerable variability and lam^ average scores on 
some task measures than the comparable Whites or FemaWT. Thus in some cases 
the performance of these two groups would be^et'esti mated by prediction 
based on White or Female data. Fro^n thes^Tdata It is not possible to conclude 
why Ijask performance is more diffifcuft than is literacy .test- taking,. 



Conclusi ons 



The 



Iproject has shown the feasibility of conducting validation studies on 
the basii^f ^ask clusters rather than' innumerable, constantly changing jobs, 
ftoreover, ft^^is possible to develop c'^iterion measures that are practical and 
more predictable than supervisory impressions. Such measures for the more 
complex task clusters, hov/ever, will be more difficult in both construction' 
and administration. 
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A job analysis form is proposed to identify the task clusters which appear 
as an*Mniportant part of any job. Wherever a cluster is found to be a signifiv 
cant p^rt of a job, the relevant BOLT subtest(s) may be used in affection • 

It is recommended that the system of task clusters be extended to higher 
level tasks and to jobs (pealing with people and things, " 
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INTRODUCTION 

The initial concept of the validity of a test centered in the question: 
does the test measure what it is designed to measure. Thus the research per- 
son sought evidence ^to substantiate that the test really measured clerical , 
aptitude or aggressiveness, or wh^itever the test was cTarhned^to measure. 
Validity was regarded as a self-contained, characteristic of the Jest (along 
with reliability). But in recent years the focus has shifted tq the much more 
specific question: do the test scpres^rreUt^ .w^^ some significant exter- 
nal measure in a given situati^on for a particular group of people. A. test is 
no longer regarded as .valid or not, but as having many possible different 
validities depending on the particular external conditions. This shift in 
emphasis is reflected in the APA Standards for Educational and Psychological 
Tests and Manuals of 1966 (later revised in 1974)# 

The change in emphasis had some effect on the practice of using tests in 
employment, initially if a test claimed to measure clerical aptitudev it was 
felt appropriate to use it for all types of clerical positions for all per- 
sons. Then studies began appearing in the literature showing how the tpst 
predicted perforhiance in a particular lemployment setting (see Validity Infor- 
mation Exchange appearing in Personnel Psychology , 1954 t^ 1965). Somehow 
this interest declined only to be reawakened by the Tes^ting^ Guidelines of the. 
Equal Employment Oppor1:unity €omm'ission and the Office of Federal Contract 
Compliance, which arose out of legislation regulating nop-discrimination. 

^ These new regulations gaye emphasis to *- - 

- empirical data to, support the validity of tests (though the altema- 
. tives oT content and construct validity are described) 

\ - ' - the development of unbiased measures of performance 

- ^spearate evidence of validity for protected classes, primarily minor-, 
ities and women , 

- a full description of the relationship between test scores and job 
performance for each group . ^ 

- evidence for each job situation 

This last requirement is the reason underlying the present study. If a 
company, a school system,' a city, any organization, wishes to use some ob^e'c- 
tive measures to select or promote its personnel, it is faced with the need 



to conduct a thorough study for each of the jobs In the organization. Becuase 
of the large number of jobs arid the cost of doing an adequate study In each 
case, the total cost of obtaiatng evidence to support the use of tests"44er-^x- 
prbltant. 'Currently many organizations are dropping the useof tpsts (see^ 
Wall Street Journal, September 3, 1975) or restricting them to certain jobs 
for which stujlij? have been completed. Unless some e^^temative validation 
strategy 'is devisect, subjective impression will replace objective measurement 
to a large extent. ' How can the validation process be modified to make it more 
feasibTe^yet provide the necessary empirical evidence? ^ .(Are there alternative 
methods for validating tests over a large number of jobs that will both main- 
tain the high standards of research and yet require a less extensive program 
of research?) ! * , 

' ' ' Proposed Solution 

0 ' ' 

Even.beftJre- the pressure introduced by EEOCC guidelines, a series of in- 
vestigators at Purdue University pursued 'the development of a procedure called 
"synthetic validity." In this method, job analysis , data are obtained to show 
the human ability requirements of the job. If there .is evidence that the pre- 
dictor measures* the required ability, then the test is said.to'^ie valid for 
that job. Instead of a direct study of jpb and test performance, aCl^nk is 
established between the predictor and the criterion through the system of 
ability requirements. The latter data are obtained through the use of the 
Position Analysis Questionnaire (PAO).' This procedure has been studied ex- 
tensively and the reader is referred jto^the PAO ..Manual for for.ther discussion 
and references. ^ ' ' - V . \ _ - ^ 

The present project proposes another alternative that -avoids synthetic 
validity and judgnents about ability requirements of :the job.. This procedure 
rests on job analysis wh16h carefully specifies the natare .of the tasks per- 
jfarmed. The link between predictor and jotJ is the "task cluster". *A task 
cluster .Is an associated group of specific tasks which are found repeatedly 
over various jobs. It is broader. than a. single task and narrower than the 
total job. ' r 

The objective ;of this project is to Identify typical Asters and demori^ 
str6tte'.the feasibility of conducting va*11dat1or> studies not job-by-job but by 
task clusters. The ass.umptions underlying the approach are: 



' h these units of work (called task clusters)'can be identified, defined 

and validated. ^ ... - ^ 

2. these task cl-ust'ers are more stable than jobs. Jobs change regu- 
larly due to reorganization of -duties, modtflcation of work flow, and techno- 
logical changes. Thus job validation studies may go out-of-date even before 
they are finished. While one task cluster within a job may change, other 
significant clusters in the job will remain the same. 

3. task clusters v)h1ch.are essentially the same appearacross many jobs, 
especially entry jobs. The content 'of the tasJc_d;i|S.teR-ffla^iffer from job 

to job but the essential process Is the sjme, e.g. alphabetical filing is the 
^same whether thef material filed relates to oyter space or house paints. 

. 4. there are fewer task clusters than jobs, thus reducing the number' of 
necessary validation studies. (See below for further description of this 
assumption.) 

5. ' If a test is valid In predicting performance on a task cluster, then 
it is appropriate ta use the test in personjiel decis^rons for all those jobs 
in which the' task, cluster is a significant (Important) part of the job (just 

criterion measure must reflect an .Important part of the job). 

A task cluster Is defined as a group of work activities oriented toward 
a specified objective. A job Is composed of a series of task clusters coninon 
* to many jojjs plus a group of tasks unlqu'e to the particular job. Th1^ coffcept 
Is charted as follows. , ' • 
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, The above chart shows that Task Cluster A appears in Jobs 1, 2, and other, 
various jobs up to Job n. Task Cluster C, however, does not appear in Job 1 
at all, but in Jobs 2, 3, and other jobs, 

^ The chart shows also the Task Clusters that' comprise each of the jobs. 
Note that in addition to the clusters there are also certain unique tasks that 
are included in the jobs, • • " • ' . ^ 

It is assumed that where any large number of jobs are studied, the nunter 
of task clusters (N) will be. smaller than the number of jobs (n). 

'Thus", the development of task modules has the primary purpose of reducing 
the number -of upits reqijiring test validation to a manageable numi?er. How 
many clusters exist in ,100 jobs? What kind of reduction can be expected? 
The exact answer would depend on performing the analysis for a given set of ' 
jobs. 

■ n ■ . ■ 



THE DEVELOPHENT OF TASK CLUSTERS AND DIf€NSIONS 



Task Data ; . ' - ' ^ 

The project began vrith the search for task data having the following . 
requirements: ^ ' / . 

U task data are ^needed from several hundred jobs 

2. the task data must be described in enough detail that similarities 

' ^. and differences can be reliably recognized 

3* the/level of task analysis across jobs must be similar if not the 

s^. For example, if some jobs are analyzed cit the level of bodily 

/ movements while others describe broad unctions, the task data will 

/ not Ije comparable. r . ' . 

, *The prime sounie examined was.. the job analysis*data bank of the Depart- 
ment of Labor, This file on microfiche contains job descriptions for thou- 
sands of jobs obtained over several decades and for different purposes. Some 
served as the basis for job descriptions in the Dictionary of OccupatioKSI 
Titles while a few provided detailed inforination for the development of pre- 
dictor* instruments and criterion measures. Several different methods of job 
analysis we're used. In many cases the description- told the work done by the 
jolte-^ut not what was done by the worker. In general it was found that, re- 
qufreman'ts 2 and 3 above were not adequately "^t* 

Other sources of taslc data were examined. Information aboiit military 
positions was found tp meet. the reqfui rements but the AdvisofV Group felt that 
•the analysis should be applied to civilian jobs in that the demonstration was 
to be applied to a United States Enployment* Service test. Other sources had 
excellent data but across a small .number of jobs, e,*g. jo^ descriptions for 
police Sind-fire positions. . " . 

The most consistent, higfe,<^^me source of job dat:a that was found was 
the Functional Job Analysis ifsk Data Bank, developed by Dr. Sidney Fine and 
others.^ The.tasjj^n this Bank are derived from a large number of clerical, 
technical and administrative pOT5itions within the social welfare industry. 
This source was supplemented by tasks from a study of clerical, security, and 
other positions prepared by staff of ^e Chase-Manhattan Bank with consul ta.- 
.tion by Dr. Fine. Additional tasks were developed for AT&T Coin Collectors 



by A.I.R. staff uis^ng WA methods. Through Dr. Fine and the Upjohn Institute, 
71 FJA tasks were obtained for child day care tasks and for old age, personal- 
care home tasks. In total, data from about 1,000 tasks were available all 
using the same methods and level of detail. 

6. 

It should be noted that the range of tasks does not cover the whole world 
of work but is'quite limited. The sample ^oeS not include work that, is heavily 
"thing" oriented and only a few hundred that are heayily "people" oriented. 
It is even hard to say that the sample is representative of all "data" oriented 
tasks' for the population of such tasks is not available. Nevertheless it was 
felt that a very wide range of such tasjcs was included. 

The FJA Task Bank has all the task information on McBee cards (a photo of 
a typical card .foTloWs). A task statement, as deffned by Dr. Fine, includes: 

a. what workers. do . * 

training content . * 

performance standards . . , ■ 

general educational development ^ . . 
worker instruotiorrs ' • . 

worker functions v . ' 

b. what mast get done 

purpose ' 

goals ' - ' ■ ' 

^constraints/conditions 

state of the^art^ procedures, TOthods, techniques 
objectives - ' 

The task card also shows the FJA level and orientation for data, people, and • 
things, and the GEO level for reasoning, mathematics and language. All the 
quan^;itative data are^coded and punched in the, margins of the car^ (not shown 
In the photo), this jnlnching allows for rapid sorting of the cards on one or 
more dimensions of the task." , . * • 

Method of. Analysis - " ' ^ , , ' 

The objective In the analysls^of these tasks was to. create a taxqnoiny 
.fon .describing all 'data (idea, information) prlente^ tasks. This woulclfbe 
achieved through- identifying conmon threads running through al 1 ..tasks and the 
dimensions of thosp commonalities. ' :« 
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A frequently used method of analysis is illjjstrated in the work of Dr. 
McCormick and his associates at Purdue University. They obtained several 
hundred one-line task descriptions, and ascertained which ones were checked 
for the same job. Through factor analysis they learned which tasks are likely 
to appear together, e.g. typists also tend to file. Since the tasks in this 
project did not generally reveal the job from which they v/ere taken, the 
statistical approach was not feasible, ftoreover the search was for dimensions 
/ which more dynamically described the job activies. 

three persons, independently using"a deck of McBee task cards, set out 
on the search for a taxonorny. One gave emphasis to the ratings of task levels, 
another to task orientation, and the third to GED ratings. The tasks were 
read over and over, sorted and resorted nany different wgys, alwsiys looking 
for comnonalities, continued, and bases for differentiation. Actually the 
three initial approaches provided little new insight. But as this process 
continued, it was found that the content of the task (welfare application, 
personnel appraisal, correspondence, deposit slips, etc.) had to be ignored 
'and emphasis given to the processes that were being performed. Once this leap 
beyond content had been made, new sets of commonalities started to arise. At 
first there were only a few, like giving out information and classifying ma- 
terial. 

This insight led the group to resilize that this entire field of work 
dealt v/ith aspects of information processing. Realizing that other research 
groups expert in this field had probably already developed taxonomies for in- 
, formation processing, the search v/as directed into these sources. Looking 
^ for such systems the group examined books on logiCf language of computers, 
information processing, language, syntax, psycholinguistics, concept formation, 
tests of higher cognition, even to teaching classifying skills to, disadvantaged 
pre-school children. No cbWion set of operations or tasks was found. Each 
author was different and yet there was great overlap. Concepts such as iden- 
tily statements, manipulating data, counting, sorting, etc. appeared across 
thes? many different disciplines. 

From all these sources we culled statements or definitions of operations 
in information processing. Each such operation Was placed by the readers on 
3x5 cards. Comparing these statements facilitated the^ identification of 
overlapping or identical processes with different names, operations that v/ere 
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unique .(different from all others) and those that were coirfJinations of more 
fundamental processes, or those"th|t were performed in a special serial order. 

Then, even before a summary set o?^^erations was developed, the research- 
turned back to the detailed, real-life t^Kstatements. (Perhaps this was due 
to a concern that the search was departinjj from practical tasks and into hypo- 
thetical cognitive realms.) Each McBee task c^rd was reexamiried to see if any 
'"^of the operations from the 3 x 5 cards app^arecf. And indeed, the words of the 
task s'tatements could easily be translated iiiTm^cases to the terms of the 
budding list of operations. Such task verbs as sorting, judging-, deciding, 
categorizing, etc. came to have much more meaninc 

It was also noted that the task statement was sometimes incomplete. Some 
additional associated operation had to have been performed but the^task, as 
written, either assumed this was already part of the task or had simply omitted 
the needed information. From person alC knowledge of the task, the task state- 
ment could be supplemented with additional operations (p.g. what the bank 
teller does with the deposit slip after comparing deposit amounts with the 
deposit slip entires). In other cases where the task was not known well, it 
was recognized that there must be some job aid, some instruction, some pro- 
cedure, some supervision that Tnust be at hand to supply certain informational 
needs. 

For some task statements there did not seem to be a relevant operation 
in the deck of 3 x 5 cards. This made sense when the top of the card showed 
that the task was described as thing or people oriented. It was thereupon 
concluded that there would be no attempt in this project to develop even par- 
tial taxonomies in these fields. . Efforts would be limited to describing tasks 
within information processing, a tremendously broad field ranging from the 
mail clerk to the president. 

Many tasks with the same verb or operation seemed to fall over quite a 
range of difficulty. For example', "looking up information" might be relati- 
vely easy (e.g. a phone number in a 'directory) or quite hard (e.g. searching 
for psychological principles to be used by a group of counselors). "Categoring*' 
could be easy in a task of alphabetizing but somev/hat hard in deciding whether 
a given personal loan situation was acceptable or unacceptable. It was de- 
cided that there would be no attempt to apply difficulty levels to each of 



operations. It was clearly recognized, however, that unless the task taxonony 
provided for more detail than just "looking up" or "categorizing" ("sorting"* . 
"classifying"), the system would be incomplete*. ^ . • . 

As attention was turned back to the task, statements, fpcus. was .given to 
thejgoal--0^^ conrion steps that appeared across most tasks. Even 

wijth a preliminary list of operations, it was cTear that most tasks involved, 
three feature?^ 

' !• information was received or obtained from some source (task input') 

2. the information was mampul ated m some way 

3. the ^ult of the manipulation was given out i.n some way (task output) 

A study of the various sources of information used on the tasks revealed 
eight main categories or dimensions -(described subsequently). These eight 
sources, either alone or in combination, were enough to describe all the tasks, 
similarly, seven methods of giving out information .could be differentiated. 

; It was much harder, however, to find concepts that organized the wide 
variety of information processing tasks. What would bring together such 
verbs as: matches, compares, sorts, catalogues, files, checks, proofreads, 
verifies, routes, refers, posts, tabulates,' rates, decides, evaluates, judges, 
appraises, approves, counts, measures? The conclusion was that the central 
process of all these tasks was taking a specific case and decidingjnto which 
category it should fall. At first, the word, sorting* was used to describe 
this process. For most lower level tasks this w&rk^ applied very well. At 
more complex tasks, sorting seemed too simple a word. If the. task(wiis de- / 
ciding if a certain welfare* applicant qualified for a given program, sorting 
seemed too simple,/and we shifted to the term, classifies, as a genetic term 
to describe all the tasks covered . by these verbs. All these l^sks involvd 
having information about a case or condition and then placing that case into 
a category (often as simple as yes vs no) according to some clais^ificatioh^^ 
system. Here are sxJrne examples of this kind of task that are^not ordinarily 
thought of as classifying: 

1. a signature on a safe deposit form is compared with a signature on 
a record card and the ^plpyee is asked to indicate, whether the 
'^fTHfl^is' the s.ame or different^ from tbe Second. 

i • - ; ^ . . * . • - • 
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2. a receptionist le.ams the nature of the visitor's needs and refers 

the person to the »»l£vant office, 
3... a clerk posts account data in- proper ledger columns, . 

4. an interviewer combines standard test scores, and reports whether 
examinee qualifies for the- top job, 

5. a guard evaluates whether air passenger is potential hijacker. 

6. a. Senator or President decides whether a given set of national and 
international conditions warrants calling 'for an atomic bomb or not. ' 

"Classifies" as now understood covered nearly all the information pro-^ 
cessing tasks, except for a few operations that were at rather high GED levels 
(4, 5, and ^ TheSe involved inferring/deducing, abstracting/sunmari zing, 
and creating^BW classification schemes. Since these activities were at such 
high .levels and hence irrelevant to BOLT, the^ full development of these clas- 
ses was not, pursued. In fact, there were not enough such tasks to make any 
further distinctfonsi. 

Within the wide range of classification tasks them/was a need for further 
dimension? to differentiate one task from another, Var^us dimensions were' 
tried out. Their effectiveness was judged by: 

,1, whether it helped to Jescriie^ the differences betv/een tasks. 

2. ' whether Tt was a characteristic found irf many, if not most, tasks, 

3. whether the dimension enabled one to envision more accurately just 
what the worker performed 6h the .task, 

, It is prpposeiJthat the most crucial evaluation of a set of dimensions is 
vrtiether or not independent readers of a given task cluster will construct es- 
sentially the same work sample test. If their work samples differ, then there 
still remains some ambivalent interpretations and different or more detailed 
descriptions are needed. This method could not be properly applied by the 
project staff since they had become overexposed to these ciescriptions. 'The 
method, however, is proposed for future similar studies.' ; 

It was found that only two additional dimensions appeared necessary in 
understanding each task and highlighting task differences'. They were: . 

1, What. is the number of characteristics, considerations, or factors 
that a worker muS^t consider in order to classify a particular case into the 
right category? 'If the worker is sorting nickels and; dimes by hand, the 



decision Is made by one characteristic, 'size. If one, is deciding^ what action 
tctake^ith Turkey as that nation permits farmers to grow poppies, the number 
of considerations I's quite 1 arge, < ,It was found that the majority of tasks, 
required the consideration of only one or two .factors. - 

2. How clear are the distinctions betweeji the^categories which the ' 
worker must use? ' Are therie specific procedures to deffne^the classes, per- 
haps through using easy objective measures? For example, everyone E>0 years 
smd older will be; given treatment A. vNic^els are readily distinguished from 
dimes. But if «the worker is deciding whether a giveri city is an average or 
above average. location to build a manufacturing plant, the worker, is hot only 
faced with a high number of factors about the city to consider, but he has 

no well-defined way of'Comblning the data to distinguish the Category "above 
average" ' from the,.category "average". 

Perhaps it would be useful to present some "of the task dimensions that 
were considered an^ discarded for various reasons: 

• 1. The number of categories, was considered as a potential significant 
aspect but later. discarded. Having only two categories may make the opera- - 
tion very e&sy or very hard. Sorting a group of two colored forms Is not 
significantly different from sorting five- or eight colored forms, as long 
as the color categories are distinctly different, ~ 

• 2. Doesn't one need to l?now something about the distinctiveness of the 
factors used to depide the individual case? *If the case's characteristics 
are sharply "defined (objective, specific, clear), doesyt this make the task 
easier than If the characteristics are^ muddy (e,g.' degrees of loyalty or- in- 
tegrity)? The answer was yes, and for a long time a separate dimension was 
used. We found, hoji/ever, that the ratings of this dimension and the ratings 
for distincti veness of ' categories was always the same. We apparently' do not 
need both dimensions. There are probably some exceptions to this parallel 
rating, but. within our sample of tasks .they did not appear with any frequency, 

3. ' Tasks also differ in the clarity of the rules for combining case 
chafatfterl sties to determine the categories. A worker may follow a mathe- 
matical .formula In combining personnel test data or in evaluating a long ap- 
plication but how does a secretary weight the characteristics of an office, 
visitor to decide wheth^er the visitor should be given an appointment wit^ithe 




boss or not? Again, after working with this dimension for some timey it was 
found that it, too, tied closely to how well the categories were /defined. If 
the boss s^^ys to give appointments to all people with certairt.<5lean-cut char- 
acteristics (e.g. customers with annual sales volume over ^50,000) , the'fcts|<. 
becomes quite different. , • 

4. We also considered at length the seriousness of the'consequ^c^s of 
niis-*classifying. Isn't the task of approving or disapprovingJ^^tf^^^ti-million 
dollar international loan quite different from a $500 T^ar^an 'auto purchase? 
The answer is yes but it was found that^the diffej^en^in tasks was adequately 
described in our two accepted dimerjsions. Th^Mg loan involves a large num-. 
ber of case charatcteri sties and no onetias developed clear cut distinctions 
between an acceptable and an lina^ptable loan. (These distinctions could be 
made by creating objective methods of measuring case characteristics and then 
defining the categories in terms of those measures. This is what has been 
done to reduce the job of classifying auto loan applicants into a fairly sim- 
ple task. This reduction has occurred continuously in the tasks found in 
business and industry. 



The final pro'duct of the search for a task taxonftmy was -a schema using 
five- dimensions as presented on the following pages. The overall structure ha^ 

1. 
2. 



Task input . 8 ways in -which input differs 
\ask action. 



3. 



a. 9 varieties of manipulation 
b» 3 levels- on the number of charactefristics or rales considered 

in the manipulation 
c. . 3 leveTs of clarity for those rules 
Task output . 7 modes of output • 



TASK CLUSTER DESCRIPTION SYSTEM 



The following system applies to tasks which are data (idea, information) 
oriented,.^ A 'task cluster description is considered complete when all fi ve di- 
mensions are adequately defined. . ■> . ' ' • . • 

First Dimension ; The nature of the source of the information/data with which 
the worker deals, with eight categories or codes. ' The" first 
• \- *• five categories relate to tasks of seeking out information. 
* • . In "the last 'three categories the worker does not hav6 to ' \ 

' . • ' . look, up qr hunt for the information but has it on hand for . 

varioits reasons. 

The verbs used to describe this Operation include: seek$, looks up,' 
locates, obtains, observes, asks-, requests, elicits, interviews; consults, dis 
cussed, converses, talks, listens, collects, gathers, searches, researches. 

1. the information is a source published outside the job and is well 
organized for use of a standard operating procedure to obtain the 
information (e.g* directories, time tables, maps, catalogues, rate 
schedules, dictionary, etc.). 

the information is obtained from persons at hand who have the infor- 
mation readily available upon being asked. 

the information is obtained from published sources which are not . 
directly oriented to provide the information sought (texts, encyclo- 
- ' pedias). May have to search for these sources. 

,4. the information is obtained' from persons who may or may not have the. 
information 'readily at hai|id. Special skill is required in eliciting 
the information,, usually/dealing with the person's, attitudes," needs', 
personal relationships, /etc. 

5. the information comes from observation of current events* objects, 
conditions, people. , . ' 

6. the infonnation used has b6en memorized from written sources either 
published butside^oivili-house. 

the ipfoipiS^ion comes from roemory^ojt past personal .experiences or 
ffom spiral education^^^ ■ ' ' ■ 




; 8, the infomation is not sought but comes to the worker 'in a form -ready, 
to be man4pulated. These tasks relate to the host of people whose, 
..^ .work is delivered to the 'mail basket. ^ ' 

Second Dimension ; Describes the kind of manipulation of the data (what is done 

tA)r with the data sought or riecefved in phase 1 (first" 
dimension). Manipulation also has riine dimervsions', using 
Roman numerals to distinguish them; 

The verbs .used to describe these operations include: 'matches, compares, 
sorts, routes or refers (mail, forms, people)., posts, tabulates, rates, deci- 
des, evaluates, judges, approves, counts, measures, 

I -compariag two sets of data to see if the components are tlfe same or 
different. 

JI examining a set of data to identify any missing information. 

III sorting (filing, conpiling, posting, etc.). •' ' 

IV classifying {e.valixate, assign, catalogue, $elect^ ^tc). ^ 

V computing (including counti-ng of cases falling into speciaT, categories\ 
VI' abstracting (surtmarizing, condensing, etc.)« - • • 

VII deducing/1n?erring. \ - ' 

' - VIII. creating/innovating (authoring). . \ • 

fx • ho manfpulatfon described. (Persqns copies data'from dhe plate -to 

^ , ' , another- withbut any npdifi cation of It.). 

♦ * ' 

Third Olmenslon: Describes how many^ characteristics , of a case or the'nurriber 

of rules 'that must be considered' by the worker in sort^-.or ' 
classifying, or, more generally, manipulating it. This di- 
, 'mension applies most clearly with tasks of sorting and clas- 
- ^ s-ifying and less well ,with others.' As tasks are presently 
described in the cards, it was often difficult to be sure of 
the proper coding of the task on ,this dimension. Three leVels 
• . ' of. descriptions were used; • ; , 



U one or two characteristics are considered, (filing by huiterical order) 

'2^'' three to five characteristics are considered, (classifying qual^^iqc 
, tions for low income, housing byage, number of dependents -a^d -income) - 

3, more than five characteristics are considered, (planning activity 
program" for senior citizenS^) * ' - • , 

Fourth Dimension; Describes how well-defined. the decision rules are'by v/hich . 

^■-^ categories are formed. Is the worker dealing with "hard and 
„ "fast (definitive) rules or general concepts/principles* . 
• Three', distinctions were made; ' • ' 

1, there are specific rules and standards easily 'identified, as required 
by the. task, • ' - , . 

2,. the manipulation of the data requires a technical measurement system, 
usually known only by a specialist, • . . - 

3. the task requires the use of general guidelines without fixed rules, 
usually verbal concepts, e,g, degree need, urgency, risk, neatness, 
etc. (Management generally seeks methods of ^*ftnoving the task from 
this category to specific rules,) ^ ■ ■.• ■ 

Fifth Dimension t Describes the' nature or form of the output of the inanif)ulation 
stask. Seven categories. were identified and a letter' code used. 

The verbs used in describing this operation includes informs, answers, ex- 
plains, .gives out, 'describes, discusses, offers, talks, providesk ad^ses, rec- 
ommends, tells, teaches, instructs^^cords, compiles, notes., 

^A. the data are placed in a standard written form or physical objects may 
be handled wi-th standard operating procedures, e.g. filipSf counting 
cash* 

B. the output is in written form but following only general guidelines 
• • (not specified as in A), , ' 

C. the output is given tp one or more persons in a standard form (simple 
informatidn given in reply to a question), 

D. .the information is given to persons following only general^ guidelines 

(explaining, making a speech), r" ; , < 



E, •ttie' information is given to persons but without any guidelines (found 
only, once)., 

F. the information is i it written form but without guidelines^ (as in 
writing stories), 

6, -the information is directly used by the worker in another task (e.g. 
worker studies a map to find shortest route and then drives by that 
. route). 

Sample tluster : The code ^or the most frequently found cluster Is as follows 
8 III i 1 A, This says that the worker deals with Informa- 
_ tlon that comes to the work setting ready for manipulation, 
that the worker sorts, files or compiles the Inforiiiatlon In 
sbme way, that ^he sorting \s rather simple, foil owing well- 
specifled rules and that the output Is In a standard written 
••^ - or physical form. This well describes many filing/coding , 
tasks and also a wide variety of other tasks. 

We have used the term, cluster to describe these conflgura- 
tlons of tasks. 



FteQUENCY OF TAXONOMY DIMENSIONS 

With the adoption of the tfek" dimensfons. as 4ust described, all tasks 
were then coded following this system. In several cases coding was very dif-. 
ficult because tiie task had not been prepared with these dimensions in mind. 
The information most often lacking dealt with the third and fourth codes, the 
procedures followed by the worker in manipulating the data. In making the 
coding decisions, the staff. w6re obliged to use their personal knowledge of 
the task or work from the descriptions of the training content and performance 
standards. ^ • 

Since interest was primarily in information .handMng tasks (as contrast§4. 
to thing, and people tasks), the cards were sorted to identify those tasks 
with 50^ or more orientation toward data and GED's lov/er than 5. A total of 
531 such tasks was found. An additional ,166 tasks with data orientation of 
30-45% were also located and were separately analyzed.' For purposes of the 
following discussion, tasks with 50% or more data orientation were used. 

With the coding system used, there was a potential of 4,536 different 
clusters (8x9x3x3x7). Below is a tabulation of the frequency of appearance.. , 

• ' . . Freque^ of Tasks w.ith4the Same Cluster Code 

r ■ (Taslks with Oata-Orientation of 50% +) 



Clusters Ocetlfring Number of Number of Percent of 

Only Clusters Tasks Involved ' Tasks Involved . 



■^ce ■ 74 74. 14% 

Twice ' Zl '44 8% 

Three times • 8 24 • 5% 

' Four times ^ 3 12 2% 

Five times 4 . . 20 -4% 

More than Five times Ji 357 67% 

Total 137 531 - - 100% 



Note two important findings from the above table: 

1. a limited number of possible clusters (137) was found in this sampler 
of tasks. A more extensive sampling of tas^s would undoubtedly revekl a 
larger number of clusters but a /lumber far short of the possible combinations. 

2. 67%. of an tasks was found to have the dimensions o-f one of 26 task . 
clusters. Thus a study of a relatively- limited number of clusters covers the* 
bulk of tasks. • . ' , - 



Characteristics of 26 Coninon task Clusters , • , 

It was decided .that further work shoulfl •concentrate on the development of 
cluster performance measures for these 26 task cluster?. The dimensions of 
these clusters were examined" In detail. The freqi^ency that each dimension 
occurred In the tasks and the number of clusters represented are shov/n In. the . 
table below. 



-Table 3 



Information Sources . 



First Code Nymber Number 

(Source of data) . of Tasks of Clusters 



> 



8 (comes to worker) J41 12 

1 (SOP frdm written) ' 37 4 
5, (observation) 35 4- 

2 (SOP from people) 15. 2 
7 (experience, educ.) 13 2^ 
4 (elicit from people) 9 - t 

3 (search In written) 7 1 
^ (memory of sources) 0 

^ > 357 - 26-, 



Among 'the 26 clusters, the bulk of tasks Involve work where the Informa- 
tion comes to the worker without any search required. (co4e 8) 



Table 4 



Manluplatlon In Cluster Tasks 

Second . Code 
(Manipulation) 

IV (classifying) \ 
III (sQrtiiig) 
^ V (computing) 

IX (no manipulation) 
I (comparing) 
II (missing data) 
VI (abstracting) 
. ■ ^ . VII deducing) • 
VIII (creating) 



The absence of -taslcs for abstracting, deducing and creating reflects the 
removal of tasjcs at 6ED Level 5 and higher. > ' ' 



Number . 


Number 


of Tasks 


' of Clusters 


119 


10 


111 


5 


40 


• 3 


39 


• 3 


35 


-3 ■ 


13 


2 


0 


•0 - 


■ 0 


• 0 


0 


JO 


357' 


26 



Table 5 



Third' and Fourth Codes 
(Characterisjics of Data)' 

1- 1 (1-2 specific rules) 
US (1-2 general concepts) 

2- 3 (3-S general concepts) 

3- 1 (5+, specific rules) 
3-3 -(5+, general concepts) 
IX no' manipulation 



Table 6 



Number • 


Number 


of Tasks 


of Clusters 


201 


12 


6 




34 . 


3 


6 






6 






357 


K 

26 


Number . 


Number 


of Tasks 


of Clusters 


276 


18 


81 


A 


357 


26 : 



Fifth Code 
(Output Mode) 

A (standard written) 
B (general written) 



Note that all outputs of these clusters were written. This reflects 
that the tasks were data oriented at a low GEO level • The task of a re- 
ceptionist or guard directing visitors to. the proper office, while a sorting 
task, is Judged to have a 50% people orientation and hence was excluded. 
Tasks of presenting training material or counseling were judged to have GEO 
levels at 5 or greater. ^ . 

^' • Table 7 

Cl usters . * 

Below is a listing pf the codes for the 26 clusters and the number of 
tasks found in each. (Total 357) ^ - . 

Cl uster • ' Number of Tasks 

A ■ 



I 
III 
V 
IX 



A 
A 
A 



7 

n 

7 



2 
2 



III 
IX 



1 1 



A 
A 



• 6. 
9 



IV 3 3 B- 



IV 3 ? B 



5 
5 
5 
5 



Cluster 




Table 7 (continued) 

Kunter of Task's 
7 

n 

8 



7 


IV 


2 




B , . 


6 


7 ^ 




1 

» 




A 


: 7 


8 f 


I 


1 




A 


21 


8 


II 


1 




A 


13 


*8 


III 


1 




A 


77 


8 


III 


3 




A 


6 


8 


. IV 


1/ 




A 


• 8 


8 


IV 


v 


3 


B 


6 


8 


IV 


2 


3 


A- 


12 


8 


IV- 


-3 


B 


16 


8 „ 


u 


3 


3 


A 


18 


8 




3 


3 


B 


21 


8 


V 


1 


1 


A 


25 


8 


IX 






A ■ 


18 



*TTie code for thifs most comnon cluster is re^d as: 

8. the informa-tioji all conies to the worker 

Hi who perfonre a sorting (filing, posting, compiling) task 

1 Involving only one or two rules, 

1 of definite nature. 

■ A putting the results in standard written form or files. 



DEVELOPING MEASURES OF CLUSTER PERFORt^ANCE (CPM's) 



The identification of task patterns (clusters) that frequently appear 
mariced the first major product of the project* It is these clusters which 
have been recommended as the units of validation rather than an entire job. 
The project proposal planned to select out of the then undetermined number 
ofclusters ten clusters^ for which performance measures would be designed. 
Jnkse criterion task cluster measures (CPM's) vould be applied to minorities 
and v/hites, males and females and the results compared with thisir scores, on 
the USES Basic Occupational Literacy Test (BOLT). 

A 

Selection^ Clusters 

A primary requirement for the selection of ten clusters from the 26 com- 
mon ones was that there measurement be feasible, in large scale administration , 
(possibly fifty examinees at a time). It would be more uiiffi cult to admin- 
ister measures for the following clusters: 

1. those which require current on-site observation of events, conditions^ 
or people (first code - 5), This measurement could ^ handled through, 
presenting a set of slides or a movie but this would be more costljf. ' 
Hence the four cltisters with codes beginning with 5 were excluded. 

- 2. thbse in which the worker seelcsTnfonnation from a 'person, clusters 
with a fir^t code of 2 or 4.' This situation ccfu Id be built for in- ' 
dividual measurement but hard to conceive in group administration. 
Hence liiese three clusters were set aside, ■ *^ ' 

3. those which require the worker to use general published references , 
which are not directly oriented to the task (e.g. tests, encyclo- 
'pedias) (first^code 3). Aside from the problem of providing ade- 
quate suji^ies'for each examinee, the more restrictive element is 
that the worker requires more time in, l|earching for the material and 
. " fevf outpu^ measures can be obtained in-^the 25 - 40 minutes available 
for any one of the CRM's; This principle excluded one cluster. 

m 

4., those which require a particular past personal experience or Spect,^. ' 
education (e.g. selecting appropriate 'games for hancKcappecf children, 
building menus for certain diets). Tiiis prob.lem put aside two 
. ' clusters with a first code of 7, . . . ' 



^ 5. those which require knowledge of a complex set of rules to be learned 
and applied (third code at level two or' three). There would not be 
time. In 25 tb 40 minutes to provide this Instruction, This is es- 
pecially true if the manipulation of data involves general concepts 
rather. than hard rules (fourth code of 3), This restriction ruled 
• out five of the clusters beginning with 8. 

The above restrictions suggest that 15 of the 26 clusters could not 
readily l^e measured In the limited time/group setting, - This left 11 clusters 
for consideration. Cluster 8 III ,3.1 A was examined and found to be'a de- 
.scription of the task of taking dictation (coding of multifaceted speech var- 
iables according to fixed rules with a standard written output). Since the 
examinees would not have this skill, the cluster was dropped. *For the remain- 
ing ten clusters, typical tasks were developed from which 13 possible measures 
may be obtained. ' • " 

Cluster Code Brief CPH Description ' 

'8_ I 1 1 A Comparing addresses off cards In a 3 x 5 file box with 

those on a list. • . 

8 II 1 .1 A ^ Checking missing data In a set of application forms. 
' 8 UI ' • 1 1 A Filing and alphabetizing a set of appliance dealer's 

cards. 

8 IX .A- Copying data on housing qualifications.. 

.8 IV \ T A J}liss1f.y1ng the size of apartment for which cases are 

qualified. X 

8 IX A Transcribing data from set'Of application forms to a 

summary sheet. ' ■ . 

8 IV.. lO A Coding data from same set of applicatfon forms. ' 
8 V 2 1 A Computing data from personnel report (includes counting) 
1 I 1 1 Comparing addresses and .phone' numbers on a. list With • 
-those in a telephone directory (different from #1 only 
in that a search must be made for the phone numbers in 
^^-^ , ^ a standard outside,, reference).' •- 
J —-rn 1.1 A Sorting zip codes by, the first three digits ( compiling . 
, data). ' . ■ • " 

1- V' I T A Calculating, postage charges for se^s of mail. 

1 ■ IX - A Looking up phone niOTbers in a'standard, directory and* . 
* ■ cogging, theni. ' , ' » • 



Requi remerits ' * ' - 

i In developing the performance measures for a given cluster^ the task 
cartels jfor that cluster were examined to identify typica.l tasks. It is impor- 
tant (that the criterion measure exactly reflect the dimensions of the cluster 
definition. All aspects of the process used by the worker must be involved 
in the CPM.' The particular subject matter or forms thatlare used are of lit- 
tie importance as long as' technical knowledge is not required (input dimensions 
6 or -7). (In support of this pdint. It was later found, that persons with 
limited literacy ability could accurately do tasks involving the use of con- 
cepts such as certified and registered jnail .without having knowledge of just 
what they mean, other. xh an .some kind of mail.) 

Tasks in which a minimum of equipment and supplies were sought to reduce 
costs and administration problems.,, A range of difficulty wasi believed desir- 
able to relate to a range of literacy ability as represented by the BOLT. 

Instructions ' " 

Instructions were made as simple as possible. Practice exerices were 
Introduced to. enable workers to understand the process and, encounter any dif- 
ficulties they might find. They were encouraged to ask questions. Adminis- 
trators were tolcf to repeat Instructions as needed. On the one hand standar- ' 
dization of measurement was sought to make performance comparable across 
groups. On the other hand the administrator was to be more in, the rdle of a 
supervisor trying to make the task clear to the worker. * ^ 



Time Limits • • . 

It was felt that on only a few jobs is there a premium on quickly complet- 
ing the task (e.g. keypunching)., Therefore it was felt desirab'le not ^o have . 
restrictive time limits to'reduce the performance of slow workers: Early 
drafts 6f the CRM's werp, tried out on groups. .wi thout tinie limits., 'it was , , 
found that a few persons woyld continue working lon^ after all the others had 
finished. Rather than to cdntfhue at such lengths ft was'deci'ded to seek a 
time limit within which 90 - 95« would finish.' (See Results, for actual % com- 
pleting.)" ' , . - . • ' . ' . ' 



36 ' . 



Performance Measure .' . ' ' 

Performance on^ach cluster was judged in terms of the' number of tasks 
performed correctly. All CPM results' were checked by two persons. Any ques- 
tions were referred to a Chief Scorer. For each measure the number of tasks 

. attempted was also, recorded. These results were used to evaluate the time 

' limits but not used in the validation analyses. 

All directions for administration, recording of performance and preparing 
measures are presented in the Appendix. 



I- 




PROCEDURES FOR 'THE VALIDATION STUPy 

"Subsequent tQ the developmetit of the CRM's, the study objective was to 
ascertaiin the relationships of the Basic Occupational Literacy Test (BOLT) 
test scores to performance on the various task clusters. BOLT is a test of 
basi<: reading and arithmetic skills for use with educatio^ially disadvantaged 
adiilts* Reading .skills are assessed by a Reading Vocabulary subtest and a 
Reading Comprehension subtest. Arithmetic skills are assessed by an Ari- 
thmetic Computation subtest and an 'Ari thmeti c Reasoning subtest.' 

• BOLT Reading Vocabulary (RV), Reading Comprehension (RC), and Arithmetic 
Computation (AC) test forms are available at four levels of difficulty. 
BOLT Arithmetic Reasoning (AR) test foms are available at three levels of 
difficulty. 

■ '■ * 

The, content of BOLT items is generally suitable" for adults; content per- 
taining to school, toys, and other children's activities is not used. In 
general, r'eading content is similar to that found in newspapers, popular 
magazines, or" nontechnical instruction manuals. 

Time limits for BOLT are generous enough to permit most individuals to 
attempt to answer every item, 15 minutes for each Reading test and 30 min- 
utes for "each Arithmetics test>, 

Most of the applLicants who are scheduled to take the BOLT will be the 
same applicants -who are'scheduled to take the Nonreading Aptitude Test Bat- 
tery (NATS). ■ ' . . ■ , 

In udditj on, anyone who is scheduled for a Spanish Language version of 
the GATE. or NATBt is given the BOLT to see whether he can be placed in 
English speaking training 6r work-environment. ' • ' 

There mliy also be instances, when art individual has been given the entire 
GATS or a certa/ln SATB and the Counselor has doubts' about the^adequacy of 
the Individual's. literacy skills for imme'diate employn^nt or occupational ' 
training." Such an individual 4s, scheduled for BOLT testing. ; 



study Design , . . 

Because BOLT had been Introduced on! j«- recently to the Stat^ Employment 
Se»*Vlc«s, there were few "cases available where follow-up would hive been 
possible. ' Instead a different type of study design was adopted, morje like 
a concurrent "validation study yet of a different nature. It, was planned 
to -administer the BOLT and the CPM's at;the same time. This arrangement 
had both advantages and disadvantages. It meant that'there would be no . 
loss of sample between predictor and criterion measures,' thus avoiding, a 
restriction in range. More, standard control of criterion measurement 
cQuld be achieved, contrasted to obtalntng measures Over a iT(yr1ad number » 
of employment sites. *'0n the other hand, task clusters of very simple nature 
would' have to be utilized, where previous experience was not necessary to ' 
the performance of the task. (It was later found that only about 10% of ' * 
the sample had ever had any paid experience doing anything like the tasks.) 
The lack of time between predictor and criterion measurement Is both dls-- 
advantage jaind blessing. Ot\ the one hand, there was not the usual lapse of 
time occurring In* employment, but on the other'hand the^re were not the un- 
fortunate modifying effects^ due to* differential- training, supervision, 
kind of experience; length of exposure; etc. th^t happen In the customary 
intervening period. 

Collection of Oata > 

The United States Employment Service made arrangements with the 
Employment Services of twelve States to administer BOLT subtests and. 
CPH's to persons for whom^the BOJJ-^afs^onsldered appropriate. Staff of 
the American Institutes for^Research visited the testing and research 
staffs of the selected States to. describe the program, and Instruct them * 
in the data collection procedures, the cooperation of these State person- 
nel was excellent and their contribution to tbe^oject is greatly appre- 
ciated. 

East State was/askett^ to^ pr^ovide ,a parti cul«^^ total 
sample, covering certain BOL,T subtests, certairt CRM's, and certain ethnic/ 
racial groups. States were selected in part in light of their ability to 
^provide certain ethnic/racial samples. All States were asked to obtain an 



even balance of males and females for all groups and this was achieved to, 
a large extent. * 

It was planned that no person would be asked, to take miore than two 
BOLT subtests. and three CRM's requiring a maximum of three hours. As if 
turned out, it was difficult to get the number of persons required, and 
sjnce some persons were willing to take more time, additional BOLT tests 
were g^fven and occasionally more GPM's were administered.. An alV cases 
Form B of BOLT was used, a form not regularly used 'in the field. The Wide 
Range Scale was administered /irst to determine, alpn^ with reported edu-' 
cational level, the, level of BOLT test to be given to the particular indi- 
vidual. Generally while these were scored, a^CPM would be given.- This 
would be followedi)y two BOLT subtests., either the arithmetic tests or the 
reading tests. Finally the remaining CRM's were administered. Suitable 
rest periods interspersed 'the administrations. „ 

Sample 

It was not easy, to ^obtain the desired sample of persons and the State 
personnel are .commended for their work in gaining cooperation of various 
groups to participate (voluntarily and without pay) in the study. People 
were^obtained from such places as manpower training programs (MDTA), walk- 
ins at ES offices, WIN participants, half-way house, for ex-of f endors , GEO 
training classes. Neighborhood Youth Corps Program, prisons. State Voca- 
tional Rehabilitation Service, and Indian Re1i|ryations^ The search, for 
volunteers was made more difficult by the requirement that they fit the 
ethnic/racial requirements and have a Tow literacy level appropriate for 
BOLT,^ The 'period originally .planned for collecting data had to be extended 
sieverial >t1mes to allow for collecting an adequate sample of all groups^ \ 

Jt was particularly hard to gain cooperation of Indian groups. Ma)iy 
times sessions were scheduled only to. have no one or v6ry *few Indians ap- 
pear. ' Xhus the Indian sample is the smallest and- the full cooperation or 
motivation of all participants is subject to question'. * 

The wide variety of settings and motivations for the measureiftent ses- 
sions is considerable. The fact that the data show, considerable congruence 
despite this , wide variance attests to the competence of the administrators* 



While there are' several cases of unusual score patterns, it ts ' remarkabl e 
that this did not occur more dften. ti seetits clear that in some- cases the 
examinee^ whtt was doing reasonably well sudjiinly decided to.giit trj^tng and. 
attempted very\ few items, -frustration, decreas.esin motivation, peer inter- 
ac^ns, headaches, etc. all could easily provide ^eviatrre^^onses over 
the fairly^ long sessions.. 

Background Data 'Sheet 

in addition to the BOLT subtests and CPM measures, each volunteer. was 
asked to complete. a- personal background data "sheet (see Appendix), this . 
fonn requested infomatlon on age, sex, education, an^ ethnic/ racial back- 
ground. , " , • ' . 

Data Analysis . ^ ' . • ^ . - ^ 

This study has 312 component parts." There are four pj^dictors (the 
four subtests of BOLT). Therp ^re thirteen measures of task perfomance, 
and there are six groups of persons (4 ethnic/racial and 2 sexes). 
4 X 13 X 6. « 312. For each of these components a separate scattergram and 
-associated statistics were produced. These statistics are number of cases, 
mean and standard deviation for predictor and criterion, correlation coef- 
ficient, intercept, and slope. Tests of significance were run for all 
group differences for predictor means, criterion^ means, corrections, inter 
cepts, and slopes. 



RESULTS 



SAMPLE DESCRIPTION 



The .final sample on which the analysis was run had the fa^lowinq* 
'characteristics: ' " .. . * •• 



ERIC 



Ethnic/racial Groups 


tl ■ 




/ • 


Negro 


525 


25.1 




Indian 


442 


21.1 




White 


596 


28.5 




Soanl^h 


530 


25,3 




' Total 


2,093 


'lOO.OX 


Sex 










"la 1 c 

Female 


1,044 

M4^>^ 


49.9 
> 50.1 

I,- 


Age . 




/ 






- 16 


12* 


.6* 




16 - 19 


617 


29.5 




20 - 24 


594 


28.4 




25 - 29 
30 - 39 ' 


319 
318 


15^ 
. 15.2 




*40 - 49 ^ 


1 9 1 


7 9 




. 50- 59 


"66 


i,2 


- ^. 


60-69 ' 


16 


.8 


Education 






Grades 1 - 6 


90 


' 4.3 


g 


■7 - 11 


1,408 


67.3 ' 




12 


488 


23.3 


(tore than 12 * 


'107 


5.1 


Removed from later analyses • 

/ • 31 


*• 






42 





wide Ranqe Scale 


Part ] 




•Part 11 




1 r 


18 


.9% 


12 -6%' 




0 


55 


2.6% 


38. 1.8% 






132 




^ 97 4^6J6 ^ ^ 




5 • 


180 
291 


0.0% 

13.9% 


162 7.8% 
228 10.9% 






354 


17.0% 


322 15.4% 




7 


• 343 


1 c a'^ 
40.4% 


401 19.2% 




Q 

u 


299 


14.3% 


367 17,6% 




No 5rorp 


41 p 


3 A f\ci 


461 22.1% 












nA 


Levc 1. 


N 


% 


Mean, Std. dev 




■ 1 


770 


61 .-A 






2 " 


388 


30.9 








95, 


.7.6 


• 






1 


• 1 






^ 1 u to 1 


1 >.Z54 


1 AA A 

^ 100*0 


lAO ^ 

103.6 20.36 


AC 


1 


583 


45.7 






2 


266 


20.8 








294 


23.0 






4 


132 


10.3 






TAf a1 
1 0 td i 


M ,276 


99.8 


109.6 21 .22 


RC 


1 


457 - * 


O C A 

35.8 






2 


287 


22. ^ 






0 


: 464 


36.3 






4 


■7A 

70 • 


5.5 






Total 


1,278 


100.1 


106.8 20.41 


RV 


■ l' 


455 > 


35.6 






2 
3 


287 


22.4 

00 • 3 




V 


4 


70 


5.5 






Total' 


1,278 


100.0 
32 


106.4 19.71 





ucu Leve4 


EL 




AR 


. 1 


115 


9.2 




2 . 


■ '566 ■ 


• 45.3 




• 3 


232 


18.6 




4 


337 


•27.0 


AC 


1 


141 


Tl .1 




2 


655 ■ 


51.4 


J 


' 3 


- 277 


21.7 




4 


200 


~ 15.7 


RC 


1 


17-7 


13.9 




2 


590 


46.2 




. 3., 


366 


30.2 




4 


124 


. 9.7 


RV 


1 


106 


8.3 




2 


565 


44.2 




3 . 


319 


25.0 




4 


"288 


22.5 



Conments : The sample described above is somewhat differerit from the sample 
on which the BOLT was standardized*' The latter had a higher orooortion of 
persons (about for whom -the easiest level of BOLT is appropriate 
(Level 4). ^ - { 

The- educational data for the study sample suggests that 5% had higher 
than hl^h school education • this additional education would apoear to have 
been a scattering of ispecial training courses of a wide variety rather than 
schooling at the.collW level. 

l^ie avera^ei performance on BOLT is also above that of the norm ^roup 
as shown by the fneaa standard scores oh the four sub-tests (rariging from 
103.6 to 10-9.6) • Variabilities, however, were very close to the nom groups 

44 ■ • ■ 



. ^ CPM pgRFORHANCE • 

The following table shows thVoveraT>\, results .-for eachl^asure of cVuster 
perforaance. The distribution of scores in all caset is skewed to the Heft. 
Most persons had relatively few errori, as one would h'ope to find on the job. 
With greater experience with the tasks,, one might exDect the proportion of ' 
errors to be reduced. The difficulty ranged from .2% errors, for coDyinq ap- 
pltcation'data to 462 errors in locating and summarizing ^personnel infoma-- 
tion, >The personnel task was deliberately selected to include one CPM of 
greater complexity. . . ' * . 

To maximize validity 4:oefficients, it would have been desirable to have 
a .more normal distribution of criterion measures. It was feXt, however, 
that the objective of these task measures was not to obtain njaximum differ- 
entiation but to se'ek a reflect on of performance on real tasks. 

The -reli abilities of the CPM!swere Estimated by means of the Kuder- 
Richardson formula 21. ' / 

,(n-l) o\ ■ ' • . 

All CRM's but one had a reliability of .90 or higher. ' One would hav? pre- 
ferred a higher reliability for Locating Personnel Information (.74). With 
only fifteen items in this CPM it was difficult to obtain the desired re- 
liability, ydt this is far higher reliability than many criteria have. 

Intercorrelatlons of CPM' s 

Because all CPM*s were, not given to all persons in the sample, it is 
not possible to haive a complete picture of all the intercorrelations. Below 
.is a table showing the relationships where at least 50 cases are available. 
The median intercorrelation is .46 reflecting" about 20? coinnon variance. 
The t\s range from J9 to .86. The highest correlation reflects a pair of 
scores from the same task, coding and copying application data (.86)'. The 
second highest correlation is for copying vs comparing telephone information 
(.81). 



There 15 Inadequate data to,xompletfr any factor analysis of thBs-e' data 
biit it seems clean th^t there is a strong general factor, probably relating 
to understanding Instr.uctlons atrd-TKehdlng to work. There Is no' evidence, 
th'at copyJjig-^ comparing, 4nd- -classifying are unique: activities. 

Administration of CPH's " . '\ 

. . The time limits established on the basis of the tryouts .were Intended 
ta be quite generous, 'allowing practically all persons to fiifish. With th,e 
exception of 'two CPH's an average of 7« of the.persons did not attempt all 
the iteips. In some cases it appears that additional time would not have 
led to completion of the CPH. In several cases it- appeal's that the in- 
structions were not understood. In other cases, while a half dozen correct 
• responses were recorded, the remainder was ^ust not attempted. 

The Comparting and Copying of Telephone Information had particularly 
high rates of non-completion, 23« and 32X respectively. Several persons 
complained they had trouble reading the fine print in the phone book and 
in time gave-up trying.* There was a similar but lesser effect with the 
usexfT the Zip Code Directory. This difficulty undoubtedly affected the 
valfdity pattern of these CPH's, 




*Some groups complained they had not been, to-ld to bring their glasses. 



PERFORMANCE ON TASK CLUSTERS 



7 ^ • 


■N 


No. 

of. - 
Items 


f^an 


Std. 
Dev. 


Avg. , 
Errors 


% * 
Errors 


Rel. 
KR-21 


% 

Did Not 
Finish 


Checking Applications 
8 II 1 1 A 


'581 


43 


39.8 


5.57 _ 


2.9 


7 


.94 




Comparing Addresses 
8 I 1 1 A 


589 


78 


70.4 


7.38 


6.5 ' 


8 


.90 


5 


Comparing Telephone Information 
1 I 1 , 1 A 


558 


50 


37.8 


11.40 


7.7 


17 , 


.97 


23 


Copying Telephone Information 
1 IX A 


558 


628 


538.5 ■ 


140.02 


i 

15.2 


3 


.99 


■4 

32 


Classifying Appliance .Dealers 
. 18 III 1 1 A - 


630 


58 


55.2 . 


7.7? 


2.2 


4 


.98 


4 


Alphabetizing Appliance Dealers 
. 8 III 1 1 A - 


586 


58 


•56.1 


3.86, 


1.6 ' 


3 


.91 


2 


Coding Application Data 
8 IV 1 1 ,A 


580- 


70 


66.5 


8.86 


1.9 


3 


.99 


7 ' 


Copying Application Data 
. 8 IX A 


582 


224 


217.9 


24.07 


0.5 


2 


.99 


7 


Copying Housing Qualifications 

8 IX,, A 


581 


46 . 


42.9 


5.63 


2.3 


5 


.95 


.6 , 


Classifying Housing Qualifications. 
8 IV 1- 1 A 


581 


46 


39.2 


9.08 


5.9 

I 


3 


.96 


' 6 


Locating and Classifying Zip Codes 
•1 III I .1 A . 


592 


35 


32.2 


5.55 


1.7 


5 


.98 


8 . 


Locating Personnel Information 
, 8 V 2 1 A 


■523 


15 


8.0 


3.40 


6.7 


46 


'.74 


9 


Calculating Postage Charges 
1 V ^*1 1 A 


52.1 


. 61 


50.5 


13.46 ' 


7.1 


12 


.98 


15 



*?tean number of errors .divided b/^mean numbeir attempted. 
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VALIDITY OF BOLT SUBTESTS 



Below is 'a* table which, siirfinaHzes the correlational data of the BOLT 
subtests by showing the median r for the thirteen CPM scores. These data 
suggest both statistically and practically significant relationships be-:- 
tween BOLT subtests and the various, criterion measures. 



* 

i 



SUMMARY OF EfOLT VALIDITY CpE.FFJCIENTS 
r^DIAN CORRELATIONS FOR THIMEEN CPM f€ASURES 

- . Among - Among 

Ethnic/ftaciarGfx)ups ' Sex Groups 
■ ■ . (52 r's) . (26 r's) 



Arithmetic Computation . .47 .46 

Arithmetic Reasoning .41 . • . .37 . 

Reading Vocabulary ^ .39 .37 

Reading Comprehension . .40 .40 

Out of the 312 Validity coefficients, only ti/enty-two (7%) failed to 
meet the 5% level of significance of difference from ^ero. This suggests 
t:hat the eighteen cases^were just random deviations drawn from a popula- 
tion where there is truly signifiCjant correlation. „ This** is not the case. 
The deviations came largely from Indian groups (10) and from twoCPW's (10), 
Copying Application Data and Alphabetizing Appliance Dealers. These CRM's 
have low error rates. 

On the other hand 25% of the validity coefficients are .50 or higher, 
with those for Arithnfetic Computation. excelling. For this subtest twenty- 
eight correTaJ:ions out of fifty- two are .50 or higher. Of the four BOLT 
tests, AC has^the highest prediction for fiiost groups. - ^ - ' 



FREQUENCY OF HAVING THE HIJSHEST VALIDITY COEFFICIENT 



Among Among 

, . Ethnic/Racial Groups * Sex Groups 

AC ' ' 35 • ^ 18 ' 

AR ■ 7 . ^6 



RV ■ . ' 1 • ' - 0 

RC 9 ' 2 



^ GROUP PERFORfW^CE 

The means and standard deviations, for performance on BOLT (4 subtests) 
and GPM (13 measures) are presented irr detail in the Appendix. In the in- , 
terpretation of these data it isr important to remember the nature of the 
samples involved: ' , ^ ^ v 

1. the sample for any racial/ethnic or sex'grpup is not a represen- 
tative or random^ sample for'that group. No cpnclusions about the level of- 
'group performance can be made by the comparison of sample means. 

Z. the sample within group is act the same from one CPM to all the 
'others. Thus, if it appears that, for example, \the Indian sample does bet- 
ter on copying telephoYie information than, in calculating postage charges, 
this difference ma^j^ reflect only the difference between two non-random 
samples of Indians. 

This set of conditions means that emphasis must be placed on the re- 
latidDShipS found, between a CPM and BOLT within samples . 

BOLT Performance 

- In all ^ but, one case the scores of Whites on all subtest? of BOLT was 
significantly higher than that for Negroes Spanish,* or Indians, The 
scores of males and female^ were generally not significantly different. 
• In 6 of 13 cases majes had higher scores on Arithmetic Reasoning^. 

CPM Performance ^ ^ 

In ,35 of 52 comparisons (67%) Whites performed better than the Negroes. 
In 25 of 52 comparisons (48%) Whites performed better than the Indians. But 
in only l§.o^5^ comparisons :(31%) did the Whites excel the Spanish. In' 
only one case did tbe minority group have higher performance "than the Wh^te 
group. [ . , 

In no cases did the male CPM performance excel that of the' femaVes. 
On the other handi females had higher performance in 36 of 52 comparisons 

im). . . ^ ' . ^ ; ' - 



GROUP DIFFERENCES IN VALIDITY 

. The validity coefficients, slopes, and intercepts for all within group 
conrelations are preserited in the Appendix. The table belovf suirniarizes the 
frequency with which the size of the^^alidity coefficients differed between 
l^e 4 ethnic/ racfal groups. _ 

" . ' Table 8 ^ 

Number of Significant Differences betv/een 

Validity Coefficients for Pairs of Groups ' 

Total * Total Number Found 

BOLT Number of No Signif. Signif. at Signif. at, Signify in Indian 
Subtest Comparisons Differences 5% Level 1% Level Differences Comparisons 



-AR 


78 


66 


• 6 


. ' 6 


12 


8 


AC 


78 . 


73 


1 . 


. ,3 


^5 


.2 


RV 


78 


68 


4 


•6 • 


10* 


9 


. RC 


78 


70 




_6 ~ 


■J. 


A 


Actual 


312 • 


■279. 


■ 14 


21 


35 - , - 


. 27 


Expecteid ' 




296 


12 . 


.4 


16 


4 



by chance' 



The thrity-five significsiht differences in the correlation between 
groups do not,occin^in a, random fashion. Rather they concentrate in dif- 
ferences involving the Indian groups <27 differences), ftoreover, the sig 
nificant differences with Indian groups arise largely from tw6 GPM's, - 
Comparing and Copying ^Telephone Information (1.9 differences)'. This strongly 
suggests that something deviant occurred in the administration of these mea- 
sures in this- group of Indians (both CPtiJ's were given to the same group). 

' (Their performance scores were unusually high with a small standard devia- 
tion producing lev/ ccfrrelations.) The differences, apart from this one 

V group, reflect the number expected in a populatio^n where there are no £rue 
^differences in correlation. ■ , - ^ 

•In the comparison 6f male -and female validity coefficients (13 CRM's 
♦ x 4 BOUT subtests = 52 pairs of r's), two' significant differences were 
obtafne'd. By chance 2.6 would be expected. ^ 

. Overall all groups -there "does not appear' to be any serious 'evidence 
for differential validity. " 

*4 racial/ethnic groups permit six comparisons of grwup ,resul ts . There arej 
six such comparisons for each of the T3 CRM measures, 'dr 78 comparisons for 
each BOLT subtest. • ' !.. - * , • 



TESf ^FAIRNESS ; ' ' . . 

While two groups "may not have significantly different validity coeffi- 
' dents, nevertheless a "test is biased if the criterion scores predicted 
from the common regression line is consistently too high or too low for 
members of the sub-grqup" (cieanf)i, The fairness of the t^st may be judged 
by examining the slppe? and intercepts .of the regression lines. The cructal 
question is w^iether or'hot the test urTderpVedicts the. task performance of 
the minority group. (Linn). - . • - 

Ethnic/Racial Comparisons 

Below are the tables v/hich show the frequency of differences in slopes 
and intercepts by level of statistical significance for the ethn-ic/racial ^ 
comparisons with the White group. 



Table 9 

Frequency of Slope Differences by Level of Significance 
'Ethnic/Racial Comparisons 



Level of Significance 






W-S 


Total 


Above the 5% level 


33 


30 


47 


110- 


Between 1 and 5% ^ 


11 


7 


3 


• 21 


At 1% or lower^ 


8 


15 


2 


25 


% of Comparisons at ' 


37% 


42% 


10% 


29% 


5% or lower 










• 


Table 10 






♦ 



' Frequency of Intercept Differences by Level of Significance 
Ethnic/Racial Comparisons. ' \' 



Level of Significance 




' W'l 


'. W'S 


Total 


- Above the 5% level 
Between 1 and 5% 
At ^% or lower 


34 

7 , 

n. 


.30- 
3 

19 • 


47 . 

^3 


111 

33 


% of Comparisons- at . 


35% , 


42%' 


,10% 


.29% 



^ ^ 5% or lower 

White^Spanish. The number of significant dlffefenc« in slopes and *inter- 
cepts between the White and Spanish groups (^) Is not greater than chance 
^2.6). No unfairness would arise in treating these groups with a common 

regression line .for all BOLT subtests an.d all CRM's. 

■ - . . o > ' 



- Wh1te>Negro^ There are. Wre than chance differences in, slopes and inter- 
cepts betv/een these groups. Of the 18 significant differences out of 52^ 
in 16 cases the Negro intercept is lower (criterion performance overpre- . 
dieted). Tbe standard deviation of Negro .CRM performance ^is almost always 
cons'iderably greater.. j ^ , " 

To' understand the .characteristics of these differences, the scatter- 
plots were examined. It was found that the significant differences in ^ , 
slopes^ and intercepts arose because of a very few deviate' cases. For 
example, the scatterplots for Arithmetic Computation and Alphabetizing 
Appliance .Dealers iook Tike this f ' . 



ATphabetizing 
Appliance 
Dealers • 



37 
1 




Alphabetizing 
Appliance 'r 
Dealers 



X 
X 



39 




Arith. Comp. 
N6gro Group 



Arith. Comp. 
White Group 



, The two deviate Negro casBS and one deviate White cas$ were removed - 
'and all measures recalculated. The results before arrd* after, w§re as follows: 



Before 



After 



N. . 

slope 
V intercept 
Mean Alphabet. 
Std. Dev. Alphabet. 
Mean Arith. Comp. 
Std. Dev. Arith. ^Comp. 



Negro 


White 


. Negro 


Wf^ite 


72 


117 


' 70 


116 


.350 


.2„97 


.280 


.357 


.137 


-.036* ; 


.042, 


' .033 


40.01 . 


52.48* 


51 .45 . 


• 53.04 


55.07 


56.77 


. 56.13 


• 56.95 


7 ..34 


■ 2.25** , 


2.72 


. 1.72** 


-lio.o 


118.26** 


110.7 


118.35** 


18.67 


18.46 


'17.99 


18*. 23 



*Significantly different from the Negro value at the 5< level. 
**$igfrificantly different from the Negro va,lu.e at the 1« level. 



Thus it was found that the significant differences in slopes and inter- 
cepts found in the sunmary statistics dfsappeared v;hen the fev/ deviate 
cases were removed; - As a result 'all the other Negro, Indis(ri and White ^ 
scatterplots were e/amined with care* , la many plots a few person^s„(one 
to five) had criterion perfonfiance more thai) three standard deviations be- 
low the remaining cases. These deviate cases Were statistically removed 
from the scatterplot and new slopes and intercepts calculated, with -the, 

following results. ^ . / 

*♦ 

»^ ^ ° 

White* Indian. After removal of deviate cases, there were only three com-. 

parisons out of 104 in which there was a significan^ifference in slope 

or intercept. This is a chance occurrence. 

Jlhite^Negro. After removal of deviate cases, there j^ere still 22 out of 
104 where there Were significant differences. These certtere'd-in the fol-* 
lowing relationships: • ' . . 

• 1.' Locating and Classifying Zip Codes \^ AC^ AR, RV and RC intercepts 
and slopes. (8 comparisorts) 

2. Calculating Postage Charges vs AC,/ AR/RC (but not R\^) intercepts ' 
and slopes. (6* comparisons) ' , 

3. Classifying Appliance Dealers ys^AC, AR (but not RV or RC) i|)ter- 
cepts and slopes. ' (4- comparisons) 

r> * 

Sex CompaHsons . . * 

SI opes. ix\ 18 of 'the 52 regression equations the male slopes are signi- 
ficantly larger than these for the female groups. These differences ^reflect 
in large part the higher "standard deviations of the. male .group on the CPff s. 

Intercepts. ,lx\]ZS of the 52 regression equations the male intercepts are 
smaller than thosia for the female groups.^ Since the -a values are partiaMy 
determined by the slopes, these xlifferences are also affected by the dif- 
ferences in standard deviations. \ ^ . . * 
. Removal of Deviate C ases. , The same cases" were removed, from the Male and. 
'Female scatterplots as from the racial /ethnic plots. After their rerpoval, 
there' were still 16 comparisons out of 104 that had significant differences 
in slope or intercept. These centewd in the follovdng' relationships; . 



1. Locating and Classifying Zip Codes vs AC,'AR and RC intercepts and 
slopes, (6 cotnpansons) • - 

. 2. Copying Housing Qualifications vs_ AR (slop6 and intercept) and AC ' 
(intercept), (3 comparisons') 

3. Copying Application Data vs RC and RV intercepts. (2 comparisons) - 

4. Copying Telephone Information vs. AC and AR intercepts. (2 compari- 
sons) 

I 

It appears that in the function of copying, the. Males vrith the lowest 
literadV skills do not perform as well as thein Female counterparts. Many 
persons of both sexes vrith very low literacy scores demonstrate the ability 
to copy. But apparently in this group are more ffeles than- Females who do 
not have the motivation to demonstrate this ability. Similar performance 
occurs in the handling of zip codes. 
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DISCUSSION ' ■ . ' 

Performance Characteristics Related to Cluster Dimensions ' «■ 

Th? ten clusters Varied iR the nature of the information-orocessing 
performed. .Thrpe dealt with comparing, thre^ involved copying, and seven 
re(Ju1red classifying. The last group had three levels: in two cases the 
classification involved oa]y a single character of the data (e.g. first 
letter in the name), three CPH's, required use of two characteristics (e.g.. 
judging housing qualifications), and two CRM's called for the use of three 
characteristics (e.g. postage rates). 

The average error rate i*s related to these dimensions. Copying CRM's 
average ^^3% errors, +/hile comparing stands at 11% errors.. With classifi- 
cation tasks the error rate is about the same when involving one or two 
characteristics (3% and 4% respectively). Ths average error rate jimps 
. considerably when the person has to deal simultaneously with three -factors 
or rules (46X). These data suggest to a work designer who is arranging 
work for low literacy persons: 

1. visual comparison of sets of data risks more errors than direct - 
copying. 

• 2. if a job obliges the employee to deal with more than two char- 
acteristics of -the information (or rules), then either provide 
supplementary job aids, or brfeak the -task, into two steps which^ 
' will avoid the three dimensions'. 

Whether or not these' suggestions apply to those who are above minimum 
literacy skills remains to be seen. 

Relative variability (standard deviation ♦ mean) also differs among 
'these groups of CRM's. Copying and comparing tasks have about the^same'' 
relative variability (.U and .18). The, thrfe'e levels of classifying have 
correspondi-ng relative yari abilities X)f .10, vlS, and .35.. Thus, simple' 
tasks of comparing, copying, or sorting require a, larger number of items 
in order to obtain a reliable measure. . ; 



Average vaUdity coefficients for the BOLT subtests vary by task 
dimension ..as follows: • ' 

copying • .37 • . . 

comparing ' .37 

classifying (1 char.) .30 ' 
classifying (2 char.) .43 ^ , . • ' 

classifying (3 char.) •■.56 ' . 

Thus the BOLT tests appear to provide higher predictions as the task 
Is more complex. 

> 

Construction of CRM's . The tas1< clusters used In this study were 
deliberately selected to be easy In order to be feasible for administra- 
tion with low literacy persons. In group sessions and In short time periods 
BOLT was validated against as many as three task clusters In a single- 
"setting." As measures are developed for other task clusters. It will not 
be as feasible to cover several CRM's at once. The construction of CRM's 
win be somewhat more difficult but no different from creating other, job 
production measures. Taped Instructions (as in dictation tests) can pro- 
vide standard Inputs to workers. Similarly, taped outputs of the worker 
can be scored later. Objective forms of job performance measures will 
become more conmon In light of the demand for unbiased evaluations In 
personnel administration. . ' 

"Pure" Cluster Measures . During administration of the CRM's, State 
testing personnel pointed out that some measures were not pure, that Is, 
the task called for performance on more than one dimension^ For example, 
in Calculating Postage Charges the worker not only has to calcul ate ' 
(dimension V) but^also has to. follow as many as two ruTes In finding the 
proper rate for' a given kind of mall (dimension IV). Sudh mixtures of 
^dimensions arfe^-not desirable. Separate measures of each dimension would 
be preferable. ' * - ' 

Content Validity ^ ' ; , ' ' 

A "psychological' analysis bf all subtasks Involved In Calcu.lating 

Rostage Charges would reveal a minimal requirement for reading Vocabulary. 

The task Includes some technical terms (e.g. certified mail) but they do 
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not have to be understood' In order to do. the task. (Most successful task . 
performers could not have explained the difference between certj^^^nd ' 
registered mall.) I.t seems unlikely that RV woujid have been,s^t^cted to 
predict performance on this task. Despite -the mlflt^na^ overt or love rt 
use of vocabulary In the task, RV correlated Irr the ',4d's with this module. ' 
Validation through content validity would have ruled out this prediction 
source. , ' ' \- ■ . - 

A.comnon source of variance does eftcis.t in^he two measurement situar 
tions. It seems likely that It lies 1n the , response to simple verbal in- 
structions, the kind a supervisor might employ on the job. Those persons 
wh^o had difficulty in, accruing a simple vocabulary may also finiJ it. hard 
to follow the verbal directions at Work. 'This common source of variance 
may underlie a significant portion of the validity of all BOLT subtests. . 
(One should note, however, that the Arftlimetic Computation Test had th? 
highest validity coefficients as a content analysis would have predicted.) 

Differences ' ' ' \ ' 

The 312 scattergrams in the study were reviewed carefully. They 
dramatize: ^ 

1. the skewed distributions for most of the -CPU measures.. 

2. the general- positive correlations, with, relatively few persons 
iscoring high on the BOLT test doing poorly on the CPM measures. Low 
scorers on the BOLT often perform well on the CRM's but a higher propor- 
tion of them have low performance. . - . . 

3. the deviate caSei. In many scattergrams there are one to six 
cases that are clearly so deviate from the others that they seem to repre- 
sent a ^Itfferent group. Th^se cases are; generally lt>w-on^^OLT and unusually 
low on CPfVs. These cases seem to reflect tlie results of working with low 
literacy, low motivated ^graups. One may well expect to have some cases - 
where directions are not understood, seen, or heard. And their perfor-/ 
mance does distort the overall pattern of results. With samples plus or 
minus 100^. a single highly deviate case can alter the statistical Inter- 
pretation of an' entire plot. With the removal of such a case a correlation..^ 
jumped from a non-significant .14 to a significant .28. Means, sloDes,,and 
Intercepts judged 'to be significantly different fall In llhe.after thcre- 
moval of two or three cases. .Thus, while 4he data of this study have been 
reported as obtained, they greatly overestimate* the true number of dlfferencies. 



■ It seems likely that many other stud1e$ reporting differential vali- 
dities (often on fewer cases) could similarly be affected by a few deviate 
cases.- Considerable future research In this field will be needed to separ- 
ate the true differential validities from, those previously produced by- -un- 
usual cases. Suimary statistics mask the results that scatterplots reveal. 
But until some accepted rules for removal of deviate cases evolve, we can- 
not afford to be subjected, to the bias of the data analyst in altering the 
facts and judging the results. On the. other hand the mean.performance or' 
a corrfelation from a set of djita is not a nunber to be regarded as fixed 
and to be neatly classified as either "statistically significant" or not. 
' \ ' '■ 

Cut-offs 

Many employment interviewers, while objecting to the use of fixed 
cut-off scored for interpreting test results, wish to have some form of 
interpretive guide. One such guide is the expectancy table which tells 
the proportion of "successful" workers that one is likely to find at each 
test score ranye. In the current project there was no definitive point 
in CPW performance t hat marke d "•success". — Onder-thesg-circamst a n ces a 
frequent alternative practice is merely to divide the test range into 
broad intervals based on tts mean and -standard deviation. This .approach 
describes test performance rather than the predicted job, performance. It 
■is a feas.lble method for eOLT. 

The scatterplots have been ex^amined to assist in the interoretation of 
the" scores. Performance above -the mean on BOLT generally addsMittle or 
nothing to task performance. The primary need is to inform the interviewer 
of the cases where speciaT attention should be given to the evaluation -of 
all information abcut literacy skills. It Is reconnended that test scores 
below'the mean should be interpreted as .follows: '* . ; • 

BOLT standard « of Examinees ^ Interoretation 

Score Expected " . - ' ' of Score • , 

,90"- WO '19« Mild cortcern about ski lis..' 

.80 - 89 15« , Likely to have. trouble on task 

. ■ ^: ' . ..performance. 

70 - '9 9X . Very serious doubt as -tb'feapabilfty. 

70 . 7« - Further literacy training essential. 



.f ' ■ ' ■ ^ * .. 

Z*^ Perfonnance on Locating PiersonneT Information involved such a high 

rate of errors,' it is recommended it be tre'ated separately. Its task 

cluster is coded 8 V 2 1 A, the code "2" indicatVng that the counting 

activity Involves consideration of as many as ttree characteristics of the' 

persons in the report (e.g. sex, jot), and length of service). This com- 

plexity adds considerably to the task difficulty. The average performance 

on this CPM had 46< errors, far above all other CPM's which averaged only 

6% errors. It is"the only CPM at. this level* Ttius special Interore^tatlon 

must be given, reflecting the difficulty that even average scorers oh BOLT 

will encounter on this task cluster. The validity coefficients for this 

CPM range Vrom nearly .50 to high .60*s for all groups with little evi.dence 

of any unfairness. 

BOLT Standard .X of Examinees ^ Interpretation 
* Score Expected of Score 

135 4< . * Satisfactory. 

r25 - 134 7% Marginally acceptable. 

100 - 1^4 39% , , High error rate expected. 

below 100 50% Unsatisfactory.- over 50% errors. 

These interpretations of BOLT scores do not g.ive full credence, to the 
few cases of differential ethnic/racial and sex performance' found. In the 
case of Negroes, unadjusted score interpretation will provide them wtth a 
"slight overpr^diction on a few t^sk clusters. Similarly, the performance 
of some Males will be slightly overpredicted primarily on copying tasks. 
Few Males, however, are competing in present labor markets for such work. 

Test Fairness : ^ ' * 

^ Schmidt, Bemer and Hunter have made extensive reviews of validation 
studieSu Involving data on minority samples. Thisr article concluded that 
there was a minimum of evidence tha^t minority groups were unfairly treated 
by the use of a common regression line, and that the frequency of any con- . 
trary evidence was not greater than that expected by chance. The study 
reported here found only a chance number of differences in validity coef- 
ftcients between minorities and Whites and between sexes. A few differences 
in variability, however, affecting slopes and intercepts, were greater than 
chance,., even after removal of deviate cases. These Instances would not 
produce unfairness to'minori ties because their predicted performance ex- 
ceeded measured performance.. 



Why is there a differential group performance on only a few tasks? 
Here are* a few conjectures to answer this question: 

1. The difference Is an "accident" arlsfng from the circumstances 
of a particular group and events In a oartlcular administration. Perhaps 
It is surprising .that more differentials did not^^ccur in a study with- low 
literacy cases derived from administrations acro^ many states with highly 
diverse volunteer groups. . In any case* evidence wHl have to be derived 
from other groups and similar measures before concluding that the obtained 
differences are "real".- 

2. Somehow there might have been different motivation for ^ minority 
group in. its approach to the BOLT and its effort on certain CRM's. If one 
consistently observed a decline in^effprt on certain job tasl^s '(as compared 
to testing), one could conclude that there is a true. differejit^ial effect. 
The difference in performance could not be ignored, however, if it arose 
out of motivational rather than ability factors. 

3. A third possibility is that there is something unique about the 
particular task requirements that induces differential performance. The 
consistent superior perfomance of Females in copying illustrates thi^ 
possibility. A similar regular rationale underlying Black-White differen- 
tials was hot identified. The only explanation for the. fact that Using 
Zip Codes appeared in both racial and sex differences is that more Blacks 
and Males could not cope with the relative.ly small print in the particular 
zip code directories, a requirement not intended by the task cluster defi- 
nition- 

The correct explanation for the few cases of test unfairness in this 
study cannot be determined within the dSta. Only subsequent studies can 
provide the full answer. j 

CRM's as Predictors • . / , 

' Some persons; in reviewing the study results have suggested that the 
COM's be,. administered as content valid measures of future job performance 
without the use of.BOli; Where one is seeking to evaluate performance in 
only one task cluster, this approach appears valid. The admtni^stration of 
BOLT, however, allows one to make valid predictions over a widp range of 
tas'k clusters with a' considerable saving In time. ' ( ' 



IMPLICATIONS FOR THE FUTURE 

The present project'had a limi^ted scope on several dimensions* These" 
will be discussed below along with the imp^lications for future work, 

c 

Additional CPM's 

Task performance measures were developed for only ten of the twenty- 
six commonly appearing tasks, Thetr success as an objective criterion is 
evident, "if BOLT .is to be applied to Yobs having task clusters in the 
other sixteen areas, the same CPM development principles used here should 
be applied in the treation of additional CPM's, The present CPM's struqttired 
measures which are readily administered in groups. Additional CPM's will 
probably involve individual administration. For examole, where vocal re- 
SDonses are a characteristic of the task, the CPM cannot easily be given 
in groups, , . 

' Some of the additional task clusters'^(4) involve information coming 
from direct experience or observation. This will require special struc- 
turing of events. Other clusters require manipulation obtained verbally 
from people: .this might bfe managed via tapes (telephone simulation). 

Two commonly observed clusters require knowledge of specific informa- 
tion learned on the job. Moreover these clusters require the use of more 
than three information characteristics. These clusters cannot readily be 
generalized and would have to be developed for the specific job setting^ 

The present CPM's involve all the, kin^s of maniuplation which are -in 
common task clusters: comparing, sorting, computing, class.ifying, and 
handling missing data. The same structures; can be applied for the new 
CPM^s, The present CPM's all use a standard written output,, the most cfom- 
mon task form. Some new CPM's would involve general written responses. 
These would require special scoring procedures such as those applied in 
objective scoring of essay examinations. 

Identifying J6bs Having Validated?' Task Clusters ' 

Initiallyu one asked If a test were valid. Then the question became: T 
Is the test valid for this specific job in this., setting. The present ' 
research shifts 'the inquiry to: does the test predict performance of this 



. task cluster; The data obtained, shows in deta41 how BOLT subtests predict 
the effectiveness of various groups on task .clusters. But hbw dpes this 
Information help at the employment desk, where questions center on jobs? 
It will be necessary to review the job analysts* data ivailahle in the Em- 
ploynient Service to see which- jobs entail which task clusters. In many 
cas6s it will be clear if one goes to the descriptions underlying the sum- 
maries printed in the Dictionary of Occupational Titles. In many 'other 
cases the task descriptions will be too abbreviated to decide what clusters 
are involved and hence what BOLT standards should ^pply. 

The Appendix pro>?i>des a guide for-the cpllectitfn of task~data which 
enables one to identify the task clus,,ters which appear in any particular 
job. This guide (Identifying Task Clusters) can be used either in obtain- 
ing data originally from incumbents, supervisors, job analysts, training 
personnel, etc. or in summarizing task data from other job analysis infor■^ 
mation. It is often found,, however, that mos,t job, analysis data is too 
general to enable one to complete the guide. Upon completion of the sug- 
gestijd form, one can readily derive the codes for each cif the important 
task clusters by completing the* following sumjnary box. 

Effects of Expe>rience 

The present measures were applied to persons with no paid experience ' 
on ihfbrmafi on-handling tasks or wltH^ relatively little experience. While 
the adminlstraftion of the measures provides some task practice, it is far 
from the degree of exposure givea by a" real job. The question then arises 
as to what degree" the rel ative performance of the various persons in the 
sample is incdrrectly measured. Would they arra.y themselves in the same 
way if they had all had a considerable amount of practice? ' Would the 
obtained validity -coefficients be quite different? ^Are some measures (the 
more difficult one?) more affected in this way than others? Tp answer 
these questions a group of persons (probably trainees) would have to be' 
given a set of performance measures several times during their^ learning 
on an informktion-handling job. - If the idifferential effects of practice 
are real, then the validity results af the present study are Siibject to 
some question. ' ^ 



Another alternative is to identify workers now employed in the perfoV- 
mance of one or more tasks for which measures have been^developed. They 
could be given both the standard task performance measures already developed 
and a task measure ti^d directly to the content of their present work^: These 
would both serve"^ as a criterion for BOLT.,or GATB. The question here is 
whether the task measure, tied directly to job content displays the same or 
higher validity than the<more general task performance measure. 

' SUWARy OFTASK ANAL-ySIS 

A B - G D E 

Major Sources of --Action Number of Clarity Task 
Function Informatioit Taken Considerations of Rules Output 

1 ' - . ■ . 

2 , . 

3 • . •' • • -■ 

4 ■ • ^ 

5 / . - 

Example" Zy VI > 3 2 B 

Consideration of Other^j' Taxonomies \ ? . » ; 

As the current project has proceeded, attention has been drawn to other 
taxonomies of tasks in the information-handling field, the systems previously 
known or discovered include those by McCormick et.al., (Posi.tion Analysis Ques- 
tionnaire), Gerferic Skills (Arthur De W/ .Smith, Canadian Training Research and 
Development Station), Sidney Fine (Upjohn Institute"), Samuel Cleff (Personnel 
Da-ta Systems), iJnite'd 'States Army /Clifford' Hahn -/aiR).,. and J.W. Cunningham' 
(Center for Occupational Education),, It would be. desirable, tq: ' 
.. 1. search for. other parallel systems s 
2. examfne the s.fmllaritiei^' and differences ; . ' 

3i examine -possible causes for differences (methodology, sample of 

tasksAjobs studied, purposes of system,, etc. ) 
4; consider value of one -or. more^ systems for future use by DOL or 
others. - , 



Systems of Tasks -^evond Information-HandHno • ' ' 

The present series of tasks wa§ derived from those that are primarily 
■(501 or over) oriented toward data. A further study would seek out people- 
apd thing-oriented tasks and develop a taxononiy for these other areas. As 
essential dimensions of/ such tasks are identified, cluster performance mea- 
sures need to be developed for them. 

Methods Used in Developing .Taxonomies 

The most common method for designing task taxonomies is through some 
fom of factor analysis. This approach seems to tell us the core dimensions 
of 'the. language used in describing" work. The present approach has been to > 
consider in detail the human processes involved in the task and.t;hen, through 
a series- of non-statistical analysis-, select a tentative taxonomy, apply a 
series of tests, modify the taxonomy, retest, and so forth until a useful 
set of classes has been derived. The details of this method, its strategies 
and rationales could be further developed so that it could more-effejctVvely 
be applied to other t?sk areas and by other task 'analysts.. 

Task Analysis . 

In the current study use was made of task data collected through Dr. 
Fine's methods of functional job analysis. These data were used because 
they represented one of the 'largest task banks with detailed information all 
collected by the-same method. Marty tasks descriptions, however, showed that 
Dr. Fine's instructions, for prepari-ncf descriptiqns were not fully followed. 
The descriptions were not always, adequate to understand accurately what was , 
done on the task.,. After the task taxonomy was roughed out, the gaps in in- 
formation become more clear. /Facts for all the dimensions were npt always 
available. For example,^ a task might state, "Decfdes, when, to order more 
clerical Supplies". This statement says very little about the process the 
incumbent follows io making the decision. Is there. data- available on in- 
ventory which serves as a basis for decisions? Are there rules for when 
or^rs are placed? Does the incumbent htive to estimate current rates of 
usage? Is it Important to minimize inventory? Are there job aids to faci- 
11^ate:^decisipn-making? Without these details one doesn'.t really know what., 
the person does. One knows only the end product of a work function. Dr. 
Fi he warns against such loose definitions' but nevertheless vagueness can ' 
readily creep into the task descriptions. • , 



Another illustration occurs* for the simplest office task: "Routes mall". ' 
In such work the incumbent may sort enveloRSs by room number, or by last name 
and then room number, or, at a more complex level, may have to read the mail 
and In light of the;^ contents make decisions based on detailed^ knowledge pf 
functions and organization. Considerl:he. vagueness of a task which underlies 
..such contnonly used phrases as: checks results, proofreads, determines need, 
searches for materials, composes letters, etc. • ... ; ^ 

It was found that until all taxonomic dimensions wfere' described, one 
could not really be sure what the person did. And vice versa: ,'one could 
readily understand what the incumbent did when all the dimensions were 
described. 

••What is needed now is a guide to task analysis that will facilitate the 
cpm'plete description of all needed dimensions of th6 job. The procedures ' 
and forms will lead the analyst to elicit complete information. The methods 
are likely to ^ll^aw more data *f rem the incumbent, learning the thought processes 
that ar6 beift'g followed during the task. Simple observation of behaviors 
doesn't, tell the whole^ story. . 'But the search for detailed information must 
not be so cumbefsome as to be impractical. Thus the need for a fnanual to - 
, make the job of collecting detailed, information ,as smooth as- possible. 

Jobs or Tasks as the 'Unit of Work , ' ^ ' j . ^ 

Thfe-current project started out to Aearn about the process of test 
^ validation, but while a^chieving this objective, it has further opened the - 

conception of the ''world of work"! The traditional^unit for describing 
' work has been the job / We work on a job , get^fJaid for a jQb > have job 

training, study job families, organize the^^DOT by jobs , validate tests for 

jobs , etc. The "job" has seemed to be the hes^ unit for dealing with the 

sphere of work. 

; ^ yet we know thereMs great varfatipn In what is done on/jpbs" with the 
same title. All persons with'the title of secretary,'. welder, or house 
painter do not do the same work. 

- they don't get paid the s^^me • ' < . 

- the1r«*tra1ning is different ✓ • ^ : 

♦ 

- jobs change^very rapidly by the addition, subtraction ..and ^ 
'^'^ modi fixation of tasks. 



, . But personnel systems have struggled to persist in the illusion of the 
job as a -stable unit. On the other hand^ we know that: 

- a task is a more homogeneous unit than a job. 

, • - a task. is a mor,e meaningful unit to describe vyork 

- a task would be a better guide for pa.y purposes 

, ^ - training can be more accurately tied to task modules rather 
than on whole jobs 

- job restructuring depends on task information 

- job analysis is really task analysis > ' c • 
'-■'as our culture has become more specialized., a more detailed 

level of work description is needed. 

. There would thus seem to be major advantages of utiVizing- tasks as a , 
basic unit in thinking about work. Some specific examples may be cited where 
an organization of tasks might be more useful than a classification of jobs. 

1. The Center for Occupational Education, North Carolina State University," 
,^has been doing some monumental work on developing an inventory of oc- 
cupations. Their same approach might have been applied to t^sks with 
much greater reliability of descripition, more valid judgment's about 
work, and classification pf work. ' ' , 

. 2. The flmeri.can Institutes for Research is developing, career guidance 
. ' pi*og>ams and curricula for providing work information. The structure ^ 
of these activities would be different if they were task-bifiented 
rather than job-oriented. Career ladders and curricula would "be 
organized quite differently. " . . , 
;3. Samuel Cleff, Personnel Data ^stems, has -developed an interesting 
methodology for' developing a job/man matching system. How much 
more accurate -the matching would be if tasks were the unit of analysis. 



Further study should be given to: ' * ' 

" - the pros and cons of using tasks as the unit of description , 

- th6 purposes or us6s for which task data would be more effective 
and where. job data would be more effective 

- formulating criteria ty which effectiveness would be judged 

^- locating, and examining currently developed task classification 
systems, 

- formulating criteria by whISh any task classification system 
should be evaluated * 

- developing a set of rjBcommendatlons regarding - 

a. future utilization of task data • ? - 

b. the next steps In developing! a task-oriented systeifi. 

Relevant Work Opportunities for Low' literacy Persons 

In a recent study cpmDleted for the Office of -Education, it was re- 
ported that 205; of the U.,S. adult popul atijon; was functtonally illiterate. 
This group was unable to perfarm accurately "simple .^tasks needed in every- 
.day life (e.g. addrgssing an envelope). Thjs'has serious implications on 
the ability of such persons to find employment. In th^ present study the 
low literacy group^ was able to per'^rm the lowest level tjasks with a "fairly 
•,low level of errors (3» to 7X), but, more and more of such work is being 
computerized. The group's errors at the next level of task difficulty . 
(i.e. responding to three task characteristics) are 'very high. Unless; 
special methods" and attention are. directed in school to cop.inq with this 
Kind of task, persons with' literacy problems will have-§erious anployment' 
problems. Their need ,is hot simply for word and mathematics knowledge but 
-for ski^il incdealing with inforniatiorr processing tasks. .It is encouraging 
tp find. that some /atCent-lbn has been devoted to ^ this problem. Bereiter* 
and Engelmann have described certain of the reasonl^igydifflculties in ' . 
"Teaching Disadvantaged Children'in the'Preschoo/'' while Bloom and Broder 
have shown that low-aptitude persons performed much more effectively at 
the college level af ter .s^*6ci al training in classification skills. This 
kind of research is '^entlal to find ways of preparing, such persons to 
compete for emplo.yment. A 



• • CONCLUSIONS 

A new taxonomy for describing* Infomation-handlinq tasks Is pro- 
posed^, ,Th1s sysCiH aDpllfiS.to a wide range of clerical, adnlni5trat1ve, 
and technical work, covering many hundreds of jobs. A grouping of task^, 
called a task cluster, was Identified Which In each case has thre^e elements 
that fy notion together: • y,^ 

a. tasks relating 'to the receipt" of the Inf^Viilatlon (input) 

b. tasks relating to how the Information Is manipulated 

c. • tasks relating to the method of cutout. 

2." A means of developing Clu^tef^Sformance measures (CRM's) was 
demonstrated. Objective, rel^aCte criterion measures of task output were 
obtained,/ 

"'a. The CPflls were utilized in a validation study ta examine. the ore- 
dictiveness of the Basic Occupational Literacy Test among groups of Whites, 
Negroes,. American Indians, and Spanish-heritage, males and females. Validity 
coefficients averagi ng -above .40 were obtained. Arithmetic Computation gen- 
erally was more' predictive then other BOLT subtests. 

4. Differences in validity coefficients among ethnic/racial, and se;< 
groups were at the chance level. A few differences in slotJes and inter- 
cepts beyond the chance level were obtained. There was no evidence that 
BOLT wis unfair to minority groups in predicting task performance. 

J. The interpretation of data concerning test unfairness was>cons1- 
derably altered by the removal of highly deviate cases which concealed the 
basic relationships within the results. Scientific procedures 'need to be 
developed- to determine jn advance the rules for the exclusion of such cases. 

6. The study demons tr?ited the feasibility. of validating oV^dictors 
against a criterion of objective task measures rather than^a t9tal job 
criteria; This validation^strategy offers m?ijor ecomxnies .over CGnven- 
tional job-by- job validation studies. 
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INTERCORRELATIONS OF BOLT SUBTESTS 



r Arithntetic Arithmetic RjBading 

Computation . ^ . Reasoning Vocabulary 

Arithmetic ^ - ^ - ' 

Computatiorf 



Arithmetic r = #64 « 

Reasoning N » 1,244 

Reading r « #45 r = #59 

Vocabulary N «' 463 N = 445 

Reading r » .50 r = •SI r = .70 



Comprehension N = 462 N = 444 . N = 1,277 
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SIGNIFICAMT DIFFERENCES WITHir'CPM'.S '« 

The follwing, tables present for each CPM the t*esults of tests of 
s^gnif-fcance of* difference Jbetween group means on BOLT subtests" (predictor 
- P), CPM group means (criterion - C), correlation coefficients (r), inter- 
cepts (I), and slopes (S). Con^arisons are made of l/hite results with 
,Negro results (W.N), Indian results (Wil) and Spanish results (W-S). The 
Hale - Female differences are described under M.F. 

The data are coded as follows: 

P 1 . . > the mean score on the predictor (AC^ AR> RV and RC) 

(If the 'White, or Hale mean is significantly hi-gher, an- H 
is shown. If significantly lower, an L 1s shovm. If not 
significantly different, an S is shovm. An asterisk is • 
^ placed ^above the or L to indicate a t value that was 
between the \% and 5% levels of sigaificanceO 

C 2. the mean perfprmance on- the, particular <:pm 
i (see. note above onNthe use of H, L, and-S) 

r 3, the correlatfon coefficients ' ' 

rronrs"in"sei^d^^ 1^ oToDr relations are significantly 
* - different fpofr^ach other, / 

I 4i the intercep.ts^ ^ , 

(a D is' inserted if the intercepts for the groups are 
significantly different, the asterisk above the D 
-showing a difference betv/een IX and 5% levels of signi- 
ficance.) 

S 5. ' the slopes * * ^ ' \ 

" . {see note for intercepts)- ' • 

To, illustrate, in the first table for the CPM, Checking Applications, 
the data fisf. Arithmetic Computation (AC) for the con^arisbn of White and 
Negro .results, shows H"^^ OSS.. This js interpreted as fono\7s: 

1. the f4rst H raefans that ^e- mean for the l^hite group on-AC-^was 
. ' significantly hi-gher than the mean for the>^legro group at tfe 
\% level. , ' 
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the second, shoWs that the mean for the White group on Checking 
Applications was significantly higher than the niean for the-ftegrq, 
group at the 5% level; ■ • *- • -- 

the 0 means that the correlation be^n AC and Checking Applica- 
tions were significantly different. , • " 
the first- S means, that the intercepts of the l^lte^and Negro re- 
gi^ssj^^quaTfbns were not. Significantly differertf. 
the second S means" that the slopes of the regression equations 
were not significantly different. .. ' 

. , Checking Applicatiohs 





P C r I S 


IM 
P C r I'S 


P C r I S 


. iVf ■ 

P C r I S" 


• AC 


H H D S S 


H H S S S ' 


/' 

H S S S S 


S S S S S 












AR 


H H D S S 




TTs S S S * 


^ RV 


H H S S S 


H H S S S 


H S S S S 


* * 

S--L S D'O - . 


RC 


■H H S D D 


H H $ S S 


H- S S S 


S L -S D S 

Z 5^ 



Comparing Addresses 





'W'N 

P C r I S,. 


. .IM 
P C- r I S 


W»S • 

P' C .r I S 


P C r I S 


AC 


,H H S S S 


■H S S D D 


H S S S S 


S S S S S 


AR 


H H S S S 


H S S D D . 


H S S S S 


' S S S S S 


■ RV 


H H S S S 


H H S d'd 


H S S S S 


S L S S S 


RC 


HH S S S 


H H 6 D D " 


H S S S S 


* * 

S L S D D 



Comparing Telephone InformafTon ^ 





P •€ r I S 


W-I 

■p C r I S 


P c r r s 


P C r I S 


AC 


H i? S S § 


* '* * 

-H S D D 0 


H H $-;U 


S L S'S^S 


AR 


H i? s s S 


■HS D-D Q 


H-".H S S,S 


S L S D S 


RV 


H H S SS 


i? S D D D 


H H S' S S. 


,S L S S S 




* 

H H^S S S, ,, 


i5 .s p b b l ■ 


/ H H . 'S D D 


S.L S S S- 



Copying. Telephone Information 







D f* «« T C 

r U r 1 0 


w»s 

P C r I S 


M-F 

P C r I S 


7 

AC 


, H S S S S. 


H S S.D D 


H H S S S 


* 

S 1 ^ n <; 

^ L O u 0 


' AR 


H- H S S S 


H L D D D 


H H S S S 


- S L S D S 


RV 


H H S S S 


H S D D D , 


H H S S S 


S L S S S 


RC 


i? H S S S - 


i? S D D D 


H H S D D 


S L S S S„ 



Cl-assif:y4ftg Appliance Bealers^ 





W»N' 
P C r I,S 


P C r I S 


P C r I a 


M'F. 

'P C r I S 


lAC 


H i? 6 D D 


H H S D D 


i? s s s s 


S S S S.S -V 


AR 


H J[ D, D D 


H H S-D D 


h"s S S.S^' 


■S S,S s s 


RV 


H S S S S 


H S S CLD^- 


4\' S S S S 

L- >^ - 


S S S 3 S ' 


• RQ 


ri S S, D D 


H SS S D 


H SS S S " 


s s s s s 



87 

A-18 



'■ Alphabetizing Appliance Dealers ^-r. -? ' 







W^I ' 


„ w»s 


H-F • 

r 




- p > r I S 


P r r T ^ 

• 


P .r r f ^ 


P C ¥• f ^ ' 

1 

V 


AC 

J 


H S S D D 


* 

H H ^ ^ ^ 
^ n o o o 


* ■'* . i 
n n 0 yt ji 


* . *■ 
^ 1 ^ n n 

O U O u u 


AR 


H S S D D 


H H D D D 


H H S S. S 


L L S, D D 


RV 


H'ff 5 D S- 


H S N S S 


H S S D D- 


S L S S S 


RC 


H 15 S S S 


H S S S S 


H S S S S 


S L S S S , 


Neither group had significant correlation. 




r 

(Coding Application Data 








IJ.I 








P C r I S 


P C r I S, ^ 


P C r I S. 


P C r I S .. 


. AC 


H S S S ^ 


H S S S 


H S S .S S 


S L S S S 


. AR" 


H SS S S . 


H S SS S 


H S S S S 


H L S S S 


RV. 


H H S D D 


H S S S S 


H S S S S. 


S L S D D" 


RC 


H H S 6 D 


H S SS S 


H S S S S 


S L S D S 



\ 
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Copying Application Data 







• 


* 


■ 




i 

WN 
P C r I S 


WI ' 
P C r I S 


ws 
p c n I s 


P C r I S • 


' AC 


H S S S S 


H S S S S 


H s s s s 


S L S D D 


AR 


H S S S S 


H S S ,S $ 


H S S S S 


* * *. 

H L S D S 


RV 


H S.S D D 


H S S .S S 


H S S S S 


H L S D D 


RC 


H S S 0 D 


H S S S S 


H' S S S S 


S L S ,D D' 


• 


y 

Copying Housing Qualifications 




-R C r I S 


WI 
P C r I S 


ws 

P C rl S 


„M»F 
P C ^ I S 


Ac" 


H s; S s "$ 


H S S S S 


H S S 


S L S -D D 


■ AR 


H S S S 


H- S S S S 


H S S S S 


* * * 

H L S D D 


RV ' 


H H S S 


H H S S S 


H S S S S , 


S L S D Q , 


RC 


H «• S p- D 


H H S. D D 


H- S S S S ■ 


S L S DD. 
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/ Classifying Housing' Qualifications 1*" 
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Classifying Zip Codes 
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Locating Personnel- Infomiatlon 





P I*" r T ^ 

■r I* r i^^^/ 


W«I 

r L. r 1 o 


r u r 1 o 


M-F 

D r »• T C 


AC 




H H S S S 


H H s s s 


S S S S S 


AR 


H H S S S 


H H S S S 


s i? s s s 


H S S 


RV 


ir ir 

H H S D D 


H S S S S 


H i? s s s ^ 


/S S S S S 


RC 


H H S S S 


H S S.S S 


K i? s s s 


s s s s s 




Calculating Postage Charges 





■ WfN 
P C-r I S 


WI , 
P C r'l S 


W-S ■ 
P C r I S 


\ H'F 

P C- r I S 


AG 


H H S D D 


H i? S S S 


i? S S S S 


L S S S S 

: 


» AR, 


h' h S D D 


, H H S S' S 


•H S S S S. 


s s s s 




HH S S S 


H S S S S 


' H S S S 


S L S S S ^ 


RC 


H^ H S%li 


H S.'SrS'S 


H S S S S 


S L D D D 




9i - ' 
'A-22V * ^ 



"0 



5^ 



CO 

0) Q 



c 

,-0 0)' 

o -r- 

l-O I/) 



o.co o cg I— I— CO o CO 



csj^ CM csj^^ CO ro ro ^ ^ i— i— 



Oi— O^r— rOffc-CVJr— ^LDCVJ 




O T 



GL 

o 
-J 



00 

* 

tu 
o 
z 
tu 
oc 
tu 

tu 

1—4 

o 

u. 
o 

tu 
o 



2= 
C9 



to 



HQ 



C/) 
0) 
C/) 

o 

0) 
■M 

10" 

> 
o 



•r- 3 

T3 JQ >«, 

q: o — 



> 



0) 



1;*. ^ 

o— 



< 



-HQ *Q -HQ *Q ^fQ ; 



-HQ Q Q-HQ 



-HQ 



Q Q Q -HQ 



Q Q 



-HQ -HQ 



Q -HQ 



-HQ 



O Q Q Q 



Q-HQ 



-HQ -HQ -HQ 



-HQ 



-HQ 



CO 



CO 



in 



4J 

0) 
U 

c 



■§> 

(/) 

'to. 
C 

-HQ.. 



C 

u 



-HQ 
Q 



ro 



in 



jQ 

m 



' 3 
lO 



c 



< < o: o: 



to 



to I— 



-HQ 
O 



CM 



o CM in cokr 

f— CM KO 

II ,11 M n 
2r CO u- 
3 3C 3:e 



































-HQ -KQ -HQ 


Q 












Q' 




1 in 


I- 3 


































































Q «Q 














Q 1 ^ 


















































CO 


CO 


























c 


0) 
























o 


■o 


















CO 








•r- 






-HQ 








o 












CO 


-M 


5 


c 








•r- 

■M 


on 


rs 








on 


ca 


O. 


io 


or 














(TS 














CO 








UUO 


mat 


eal 


De 




(tS 


cat 




M 
OJ 


(tS 


0) Q 

o> 








^- 




Q 


0) 


Its 


-M 




ftS 


C 




rtS 








c 


o 




u 


-M 




t. 


3 










CO 








0) 




(tS 


Q 




O 










' c 




t 


c 


U 


(tS 


Q 








if 






o 




CO 


0) 




c 








ftS 


o> 




0) 




^co 


c 


0) 






C 




3 


c 


CO 








o 


•r- 


'5. 


o 




O 


•r- 


CO 






(TS 


CO 




c 




o. 


•r- 


■M 




CO 


ftS 








U 


0) 




o 


Q. 


< 


■M 


10 


o> 


3 






CO 




•r- 




0) 




O. 






U 


c 


O 


o> 


1 












o. 


< 




u 




•r- 


3: 










O. 




0) 


0) 




c 






CO 




■o 










< 








•f— 


r-» 


'q. 


3 


o> 


c 














'oj 


C 


N 


O. 


O. 


O 


c 




CL 














•r" 


o. 


< 


X 










CD 


c 


c 






4J 


< 








o> 




















o> 


c 




















c 


c 






•r- 












•r- 


CO 




c 






CO 




■M 


3 




O 


o. 




>^ 


CO 


x: 




' >^ 




V) 




(tS 






0) 


§ 




O. 




o. 




O. 




. (tS 


U 


u 










1 


o 








o 






o 


o 












o 


G 


< 


o 


o 




o. 


-J 
















































^ 






92 





0) 

rts 
E 
0) 

13 



I 

tu 



CO 

c 

(tS 

o. 

CO 

51 



rtS f— 
CO 0) 

O 

0) 

u 

Si 

c 

0) (tS 

x: ,u 
^- 

T3 C ' 

0) cr 

CO 

0) 

CO CO 

c c 

CO E . 

•r- 
U 

d) 

4-* I— 
•«-> 0) 
0). > 
I— 0) 

o 

in 

=^5 



I 

CO 



c 

ftS 



c 



51 



0) 



--7 



o 

0) 



51 

4^ 



I 

3: 



erJc 



1' . 




C7) • 



a. 
ui 
o 



UI 
UJ 



CO 

(/> 
UI 

o 

UI 

ex: 

UJ 

u. 



0) u 

o: o ' 
> as 



o 

Si 

> 



> 



4-» C CO 



x: o - 



u. 



o 



0) 
CO 



u c • 
O i/} 

< Q 



r— CO *n in ^ o .CO ^ ^ O o co| ^vo 
00 csj c<i.>cg ^ cnf CO CO ^ c\j ^ ^ <c5j CO 
CO r- o r-, ch vco o ^ 10 in coj OJ 



O 00 « 



CM 



Q Q Q ' 



•ICO 



•ICO o at 



♦cif 



000 



o o 



in 



• ,4tO 



•icO 



•ICO 



CO 



O^'lcO 



•KO O -ICO O 



Of o o o o 



o o 



o o 



in 



to 



•ICO 


00 CO CVJ 




fmm fmm -^m {NJ 


0 


II II It II 


0 


0 QC > 0 




<< 0^ a: 



•ICO 



•ICO O 



' in 



HCO 

o 



-HO 



00 CVJ in ^ a» 
^ CVJ cal^ 

tt ti ti ti 

Z i-H CO Ul 

• « • • 



^<|cO<|cO O O 



O •ICO 



o| ^ 



CO 

o 
p 
o 



a 
< 



G, (/) 

a. .i- 

f- ' C> M 0) 

4-> o L ^ 

(tS f- 0) «tl 

£ 0>* 

u 

0) c 

C ♦r- 

^ 

'a ^ 
c 

C7) •ff— 

C N 

Q) Q) h~ •ff— 



m o 

•O 0) 
< h-. 



P 



0) 
0) 

'oJ 



u 

01 

o 



i. 1. 

Isl o: 

§ § 



5 



>) -P 
«fr 01 









(/) 


(/) 












c 


0) 












0 


T3 














5 




•ICO 






(/) 


•p 


c 








c 


«d 




0 


u 






0 


u 






0 
























Nl 




01 0 


















«d 






O) 








P 






C 






p 


(IT 




3 




$. 


JC 




0 




0 




C 
1— 4 


0 




C 










01 




0 


3 


c, 


(/) 




O) 


0 


•r» 






(/) 


'oJ 


(0 




P 


(/) 




c 


p 


p 


S 




3 




c 


(/) 


4d 




c 


0 


u 


0 


0 


u 












a. 


















- 3 




c 


01 










c 




a. 


c 


























«p 






O) 




c 


c 






p 


c 










c 






p 


•p 


3 




>^ 


>. 


(/) 






U 




a 


0. 


m 


u 


u 




0 


, 0 


Co 




0 


^ 0 




CJ 




G 







4J 

01 
U 



4-> 

.C 

u 



c 

•ICO ' 

• « 

c 



u 01 

p >^ 
«p 

(/) 01 

o 

C «P 

01 
u 
01 c 
u 01 

C I. 
01 01 

01 «f- 

c 
01 <a 



T3 C 

<P f- 
^ (/) 
01 

(/) (/) 

c c , 

01 

o 



<P 01 

• di >^ 

01 

O 

tn 

c 

01 01 

x: x: 



0) 
01 



c 
<0 

CO 

>' 

0)1 

«p 

CO 



C 

01 



2 

0)c 

01 
P 

•r» . 

I 



ERIC 



93. 

/V-24 



« to 



c 
o 



2 3e 



22 0) vi-H 



UJ 

a. 

o 
-J 

to 



UJ 

3: 

CO 
•Ic 

to 



0) 

> 
O 

O 



i-H > 
O g 

UJ 



C r— 

■a X) 

0) u 
on o 



bO 

< ^ 



u c 
4-> 



C3 



CL 
O 



o o O O CVJ o o 
O O' O O f— O r— 
CVJ CVJ CVJ . CVJ O CsJ . r— 



O O r— r— I U> 

J- ^ rs. ooj ^ 



•ICO 



O CVJ 



(A 
bO 

c 

E 



•leo 



-IcO O O 



■ICQ ^ 



•IcO 




C r- 
(d OJ 
U > 
OJ 

C ^ 

(/) OJ 



> 

O" 
E 



. O 



OJ 

i. 

(A 
OJ 
(A 
(O 

0) 
4J 

fd 

OJ 

-o 



bO 
■M 

(d 

-M 
(A 



Jd 

0) 
U 

c 

OJ 



tn 
c 

O (A 

•r- ,0) 

■M (A 

(d (A 

k. 

Q. -T3 

o>, c 

c ^ 

1. 

^ (d 
u o. 
Of- E 
^ o 
o o 



c 
o 

c 

■M O 

(d •r* 

E-M 
<d 

J- 

C O 
C 

c 

O ^ 0) 

^ c 
o. o 

f— Q. 
C 

s- c 
Id 

E S 

o o 
o o 



0) fd 

Id Si 

S OJ 



OJ 

u 
c 
<d 



o. 



o. 
c 



>) 

W OJ 

*f- X) 

(A x: 

(d Q. 

o < 

























(A 


(A 














C 


0) 














o 


■o 
















o 












(A 




o 


' c 










C 


(d 




o 










O 


u 








o 






•r- 


•r- 






(A 








-M 




M 


(d 










(d 














(d 


u 




o> 








<d 






(d 


C 


o 


(d 




-P 


(d 






•r* 










o 




O 


>, 


c 


o 


















c 


Id 












c 


o 


3 


c 


(A 




O) 




o 


•r* 


O 




(A 


-'oi 


fd 






-M 


dD 


^ (A 


fd 


c 


4J 






(d 


3 




c 


(A 




S 


u 




O 


O 


o 


o 


r 






•r- 


31 




(A 


Qu 








(A 




■o 


1. 








o. 




O) 


c 


0) 


cn 




O. 




O 


JC 




OL 


c 




O. 
















•< 






>^ 




O) 






o> 




o> 




c 


c 


fd 




c 


c 






♦TP 












CAu 
















(A 


fd 




u 










fd 


u 








o 


5 


5 




o 


o 






o 






o 



























(A 



OJ 

u 
c 

OJ 
OJ 



C 

fd 

o 



OJ 

fd 



^1 

OJ 

'fd 



u. 



15 
o 

(A 
OJ 

s. 

OJ 

(A 
OJ 

c 

OJ 
OJ 



T3 

bO l-H 



C 

fd 



(A 



T3 fd 

<U E 
5 Q 



CA 

>t fd 

Q. 

to • 

•r- • OJ, 
^ • 4J 



OJ OJ 
-M > 

OJV- 

(A 

C 

♦f- in 

lA OJ 

•M 

I- ^ 
' OJ 

•M fd 

OJ OJ 
r— ' U 

c 

O OJ 

oj ^- 



c 
fd 

u • 
•f- "a 

OJ 

c fd 

O) r- 

(A U 

OJ 

f 2 

3 fd 



z OJ -a 



o 
s. 

OJ 



^1 



4J 



ERIC 



9; I , 

. ■" A-25 



01 o 

z: u 
ex. c ^ 

O 01 
•— 0) 



O U. 



c c 

<r* 0) 1-4 

10- 0) 

CJ u - 



CO 
Ul 

o 

Ul 



tn 

Z 01 
UJ~ (/) 
UJ (O 

? " 

UJ 01 
CO 4-1 

Ul M- 

oc o 

Ul . - 
U. I— 

u. m 
^ > 

Q O 



o><o - 

C I— H-i 

<d m ■ 

Q) U 

a: o 



u o> 



E O 

-c I/) 3: 

U QC 

< 



o 

OJ -IJ 

•M 3 
f- CX - 



Ul u 
O 01 



o 

1-4 

00. 



CL 



oooofOr^'o^cNJomo^lio 



oooc\joo»— cNji— oo»— olr^ 



cvj CNJCNJ ooi I— a> a> c^r^^p^ ool co 



* Ql CO 



Ql ^ 



«t3 



CO 



Q CO 



CO 



o 



in 

0) 



II II 



CO r^lco 



CJ 

< 



II |i 

pc: > CJ 
< oe: oe: 



f— CVJ 



2fe 

N It 



/ 


















o 






CO 










» 








i/i 


























c 


























o 














c 






to 








<s 










o 














c 












c 


to 


0) 




c 


<o 




o 










■•-> 










o 


u 




•r- 




o 












(0> 










-M 


tn 








i 

u 


at 


to 






at 




M 


<0 


OJ 


o 


« 




o 


E 








<o o 






E 


? 












0) 


<0 




• <o 




o 


<0 










O 




u 




s r 


3 










to 






««- 


0) 


c 


<0 


p 




c 


o 


✓ 


c 






c 


u 


(O 


o 














o 








c 






c (b 








OJ' 






0) 


-x: 




<0 




c 


O 3 


c 


CO 


r— 


o> 




■•-> 


to 




OJ 






o 








OJ 


(0 




<o 


to 




c 












(0 


c 








2: 


a 


o 








(0 D) 


3 




c 


tn 




' 




OJ 




o. 




*0 


U 'C 


o 


G 


• o 


o 












<. 




u 


*^ ^ 


ac 




(/) 


CL 




'o. 




'5 


OJ 


c 


















< 






o> 






O. . 3 


o> 


c 


















N 


a 




c 




CL 


c 








. o> 








o. 














cry 


c 










< 






o> 


o> 






c 






o> 




01 








c 


c 












c 








c c 
























c 


•f— •f— 








3' 




u 


















<0 




u 




OJ , 


1 

CJ 


t- 




<0 










u 


3 






Ch 


5 


5 


G 


<• • 


CJ 


5 5 


G 


o 
-J 


Lo 


Ca 


*- 











* 


OJ 






> 








ID 




i 


<J. 


















•f- 










o 






c 












re 










OJ 


mean 




ses w 


















OJ 


c ^ 




4-> 


(0 OJ 






- <J > 






. ^ OJ 




> 






OJ 






"O 


c v« 










4J 






<0 


OJ 


• 






' OJ 






<o 






E 




(0 <0 


w 


«*- . 


u 


u. 




^ f- OJ 




O 


•M U 


^1 


iA 


iA C 


>l 




f- OJ 




•M S. 


OJ 


21 


<0 OJ 




OJ 


•M «*- 


<0 




««- 


3: 


th 








1 


OJ 


o 




u 


C -M 




c 


c 


• 


OJ 




?r 


















C 


^-. 




(0 




c c 


•r- 




OJ 


•o 




!• 'f- 


. c 




OJ 




C/) 












C 


f- c 




<0 






o. 



.1 



OJ OO 
f- OJ 



« • «^ 








r 


3: 


r OJ 0) 






. -M > 






OJ 


• 


C 


0^ 














• « 




o 


0) 




s. 




OJ 


o> 


C « 




OJ 


0)rn 






3 




(/) P 


OJ -M 


^1 




.4J <0 




««- <o 






0 u 


« OJ OJ 


OJ 


OJ 


. r^ U 










OJ « 


o| 












OJ 






c ««- 






OJ ««- 






2: 


OJ XI 









9r> 

A-26 




IDENTlPyiNG TASK CLUSTERS - 



Job to. be described: 



-Date--^ 



Described by: 



name 



Employee,^ Supervisor, Trainer, 
Job Analyst^ or other. 



This form is to be used only for those jabs where ideas, information, or 
^ data are used. Within any such job theto|^^ usually. from onelto five 
major functions. The form below pro vicjCT^ means. of describinq the tasks 
that go together to see that eacK function is performed. * J 

Fijrst, describe in from one to five sentences each of the major job func- 
tions. Avoid describing minor duties or occasional duties. Include state- 
ments only if the functidn Is an important or very, significant part of the 
job. Number each major function. The description of tmi first function 
has been started. . C . 

Function ; ' " 

1. To 



9G 



Describing Each Function ' 

Under each' heading you wiVl further describe the tasks* that are qerfonmed 
to serve t-hat function, ^ - . * 

yources of Inf ormation Used in the Task 

Despribe the sources of the Information 
used In the task. Read the following num- 
bered 1-^t of possibilities and for each 
funcj^elr^wlte in the proper coluRm the. 
nu?nb^(s) of the sources used; 



^ajor Functions 



1 


2" 


3 


4 


' 5 













1, Obtains Information from published sources which are well-suited 
to job task (e,g, directory, catalog, map, dictibnaV^, rate schedule, 
time table), 

,2, Obtains information from. resources (e,g, files , manuals, guides, 
etc), ' """^---v^ 



3, Searches for information from sources where data are not readily 
available. 



4. Seeks information from fv^rsons by phone or In person who hav^ 
Information readily available 

5, Obtains information ff^ peT*5«i§^jUSlng specialized skills to 
elicit attitudes, underlying needs, personTTTetirt+wsi^^ 

.6, Must rely on personal memory- of written sources, 

7, Observes current events, objects, conditions, peopl^, 

8, Information comes to employee in a form ready for work (e,g, 
from files, fbrms, people, etc.). ^ ^ 

9, Other (describe on back of form). 
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B. Action Taken 



T 



Describe -what is done to or with the infor- 
mation sought or received in Task Read 
the follovring list of possibiTi ties and for 
each function record TrTthe proper column 
the Roman numeral (s) for the action takenT^ 



^ajor functions 



1 


2 


3 


4 


5 








> 

> 





I Comparing two sets of data to see if the components are the same 

or different, 

» » 

II Examining a set of data to identify any missing information, 

III Sorting (filing, compiling, posting, etc?)., 

IV Classifying (evaluate, assign, catalog, select; etc.) 

' V Co^uting (Including counting of cases falling into soecial 
categories). 

VI Abstracting (summarising, condensing, etcj, 

VII Deduci ng/i nferri ng, 

VIII Creating/innovating (authoring), 

IX No manipulatii)n performed. (Persons copies data from one place' 
tp another without any modification of it,) . 

X Other (describe on back of form), 



C. What is Considered 

In deciding what action to take, the employee 
* must consider various relevant information, 
^ conditions, rules, standards, etci (e.g. age, 
sex,4Ji^e^, size, color, etc., etc). List 



the factors that are consideredjn this func- 
tion, and record the total number of consi- 
derations for each function.— ^ 



Major Functions 



' 1 


2 


3 


4 


5 
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CTarity of Rujes 

^ In making these decisions, how specific 
are the rules, guides, or standards that 
are ^folToweU? .Indicate the degree of. 
specificity by writing in the number of 
one of the following choices: 



iajor Functions 



.1 . 


2 


■■3 


, 4 


5 




< 









, K Very spepific guides, clear-cut procedure^ with definite catego- 
ries, little leeway for .judgment. 

2. Specificity lying somewhere ;feetween 1 and 2. 

3. Very general guidelines, no fl^ed fules, categories vague, uses 
general verbal concepts (e.g. deals with degree of need, urgency, 

^ moraV risk, j^tc). 



Task^ Output 

What ft the form of output in this function? 
•How are the results of the work expressed? 
4^*ead the following possibilities and record 
the proper letter(s) for each function. • 



iajor Functions 



1 


2 


3 


4 


5 













A. The, data are placed in a, standard written form or physical ob- 
* jects may be handled with standard operating procedures, e.g. 
fiVingi counting cash. . . - 

B» The output is* in written form but following only general guide- 
lines (not specified as in A). 

C. The output is given to one or more persons in a standard form 
(simple information given in reply to at question). 

D. The Information is given to persons following only general • 
guidelines (explaining,* making a.^peech')'* 

E. The informatioh is giveh ta persons but without any guidelines 
(found only ohce). 

F. The information is in written form but withtiut guidelines (as 
in writing stories). 

G. The information is directly used by the worker in another task 
(e.g. 'worker studies a map to Jind shortest route an<I then 
drives by that route. 

H. Other (describe on back of form J. 
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Checking Applications 

Comparing Addresses 

Comparing Telephone Information"" 

Copying Telephone. Information 

Classifying Appliance Dealers 
Alphabetizing Appliance Dealers 

Codi^ng Application 
Copying Application Data 

Copying Housing Qualifications 
Classrfyiijg Housing Qualifications 



LdcaMng Personnel Information 

t 

Calculating Postage Charges 

\' Total 

I 

Percent 



NUMBER OF PERSONS WITH 






' PAID EXPERIENCE ON MPM TASKS ' 






No 

Experience 


Experience Something 
Like MPM , 


Experience Exactly 
Like f-iPM 


No 

Reply 


495 


n 


70 


• 7 


, 474 . 


25 


85 


7 


486 


13 


43 


16 


493 


13 


39 


14 


488 


23 


108 


11 


500 


8 


54 


21 


542 . 


4 

• 


> 

; - 26 . 


11 


,535 


10 '. 


31 


19 


435 


19 


50 

1 


19 


456 


Ji 


46- 


8 


,4,904 


137 • ' 


• 502 . ■ 


133 


86% 




9% 


2% ■ 
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STATISTICAL FORMULAE 



\ 



The follovring fobiulae were used in various phases of the statistical 
analyses*: 



\ 



vr 



CT" ^ 



CP i 



/ > 



A/ 



« ^ 



a. 




a. 
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IMrections for Administering and' Worksheets for each CPM, plus Special 
Scoring Uirectfons and Background Data Sheet are contained in -the following 
pages. ' . ' 
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Directions for Administration 
Checking Applications 

Distribute to each person a Recording Sheet and one set of 9old 
Application forms (15 forms to a set). When. completed, say, "Each of you 
has a 'set of 15 Application forms, and a Recording Sheet. Write your name 
and Identification number on the Recording Sheet." (Pause) When all per- 
soji? have completed the heading Information, say, "Now read the Instructions 
while I read them aloud." 

./ ^ , , 

\ - Instructions 

"You work for an agency that provides various services to the public. 
To apply^for these services an individual must first complete an APPLICATION 
FOR SERVICES form. For.^this task you are to assume that part of your job 
is to review each application to see if all the information has been given. 

To do this task you will need a set of "completed" APPLICATION FOR 
SERVICES forms, this RECORDING SHEET and a pencil . Write onl^ on the 
RECORDING SHEET . DO NOT WRITE on or make any marks on the Application forms. 

You do this task by reading an Application, looking down through the 
form to see if any required information has been omitted. When you find an 
item that has been left blank, circle the number of that item on the Recording 
Sheet in the space provided after the applicant's name, but do not write or 
make any marks on the Application form itself. Review the entire Application 
form for each person and circle the number of each item that has been left 
blank." (End of Instructions) 

"Now look at the first Application." (Pause) "The person's name on ^ 
this application is Lawrence El Brpwn. There are 15 kinds of information 
to be supplied by the applicant. Some of the items require a written answer, 
others just require a check or "X" mark in the appropriate box. 

" Reviewing, J4r. Brown's application, we see that items 1 and 2, name and 
address, have been, filled out. (Pause) Item 3, the Social, Security Number 
has been left blank. On the Recording Sheet notice that the number "3" has 
been circled on the line after Mr. Brown's name since item number 3 was not 
filled out on his application form. (Pause) 



"Looking back at the application form. Items (slowly) 4, 5, 6, 7 and 
8 have all been answered. (Pause) Notice that for Items 6, 7 and 8, one, 
and only one, box must be checked for each Item, with the other box left 
blank* .(Pause) 

Item 9, however, has not been answered. To answer that Item either 
the Employed box or the Not Employed box must be checked. Since neither 
box was checked, the number 9 has been circled on the Recording Sheet to 
show that Mr. Brown also left Item 9 blank." (Pause) 

' "Looking again at the Application form we see that answers have been • 
^Itten In or boxes checked for each of the remaining Items on the form, . 
through the last Item, number 15. On the^cordlnq Sheet the circles around' 
the 2 and the 9 onthe line after Mr. Brown's name show that only Items three 
and nine were not completed on his appl1catl9n fo.rm." 

>"Now you are to go on to the other application forms and go through 
them In the same way, looking for Items that have not been completed. The 
Number of each Item that has been left blank Is to be circled on the" Recording 
Sheet on the line for that application." ' 

"Are there any questions about what to do? (Pause to answer questions.) 

"Pleasfe do not write on or make any marks on the Applications. Pegin 
now. Raise ycvjr hand If you hwe any questions and raise your hand when 
'you have finished." . ' .V. 

Record the starting tlme.^ 

As examinees complete their work, be sure to remind them to complete the. 
experience questions. If any persons are not finished In 1£ minutes working 
time, ask them, to stop and yott mark their papers, "DID\NOT FINISH". Be sure, 
however, to obtalii their answers to the experience questions at the bottom. 
Collect all sets of Applications and Recording Sheets. 



Supplies needed: 

1 set of, Applications (15, gold ) 
1 Recording Sheet 



Name 



Identification Number 



RECORDING SHEET 
CHECKING APPLICATION^ 

' Instruction's 



You work for an agency that Fjrovides various services to the public' 
To apply for these services an individual mus't first complete an APPLICATION 
FOR SERVICES forin^ For this task you are to assume that part of your job 
is to review each application to s'ee if all the information has been given. 

To do this task yoii will need a set of fifteen "completed" APPLICATION 
FOR SERVICES foms, this Recordinq Sheet, and a pencil. Write only on the 
Recording Sheet. Do not write on or make any marks on the Application forms. 

You do this task by reading ati Application, looking down through the 
form to see if any required information has been omitted. . ,When you find an 
item that has been left blank, . circle the number of that item on the 
Recording Sheet in the space pro;/ided after the applicant's name, but do 
not write or make any marks on the Application form itself. Review the 
entire Application, form and circle the number of each item^^that has been 
left blank. ♦ . * ' 



APPLICANT'S 
NAME " 



APPLICATION ITEM NUMBERS 



1. 


BROWN 


1 


2 




4 ■ 


5 


'6 


7 8 


(9) 


JO 


i: 


lPl2 


13 


1'4 


15 


2. 


BURKE 


1 


2 


3 


4 ' 


5 


6 


7 "8 


9 


10 


1" 


I 12. 


13 


14 


15 


3. 


COLSON , 


1 


2 


3 


4 


5 


6 


7 8 


9 


10 


1" 


1 12' 


13. 


14 


15 


A. 


EDWARDS 


1 


2 


3 


4 


5 


6 


7 8 


9 " 


10 


1" 


1 12 


13 


14 


15 


•5. 


FELTON 


1 


2 


3 


4 


5 


6 


7 .8 


9^ 


10 


V 


I. ' 12 


13 


14 


15 
•» 


6., 


GRAHAM 


1 


2 


3 


4 ' 


5 


6 


7 8 


9 


10 


1 


1 12 


13 


14" 


15 


.7. 


HARRIS 


V 


2 


3 


4, 


5. 


6 


♦7 8 


§ 


10 


1" 


I 12 


■13 


14 


15 


8. 


MIKANO' 


1 


2 


3 


4 


5 


6 


7. -8 


9 


1.0 


« 

1 


I 12 


13 


14 


15 


9. 


MORENO • 


1 


'2 


3 • 


4 


5 


6 


7 8 


,9 


10 


1 


1 12 


13 


14 


15 


fo. 


-PETERSON 


1 


2 


3 


4 


5, 


.6 


7- '8 


9 


10' 


1" 


1 12 


13 


14 


15 



CONTiHUE ON- OTHER SIDE 



ERIC 
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APPLICANT'S 

n. SAfiCHEZ 
12. SCATZ 



' ■ APPLICATION ITEM NUMBERS 

1, 2 3 4 5 6 7 8 9, 10 1 
1 2 3 -4. 5 6 7 8 9 10 1 



13. SPINOLLA 1 "2 ^ 3 4 5 6 7 8 9- 10. 1 

14. TRACO 1'2 3 4 5 6 7 8-9 10 1 

15. n^ILSON ,1 2 - ^ 4 5 6 7 8 9- 10 ..1 



12 M,3 14 15 
12 1^3 14'. 15 



1.2 13 14 15 ^ 
- 12 13 14 15 
12 1-3 14 15 - 



1- 



Have you ever had a job on which you were paid 
for doing- a task anything Ijjke this task? 

. ... - □ ■ □ . ' 

■ Yes No 

for doing a task very much like this one? 



□ 

Yes 



□ 

No- 



0 
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* * 




• 


" i 


WpRKSHEET' 


COKPAf 


ING ADDRESSES 



Name ' 

Identification Number 



K. 'JaineS Martin, 

1,14 East Royal Street 
Hadley, Ohio 44429,' 

2. Ralph Gomez 

2913 Hasbrook Road 
Lesbon, Mast., 01528^ 

R & P Hastings Co^ 
E. Parks Drive 
TacoiTft, Washington 98403 

Hiss Jane Stewart 
Atlanta St. " ' ' 

McAfee, N.J. 07438 



Same Di>fferent 

TX — trr— 

s X 

. s- • q. 
s . 0 

S D . 



Same TH-^ferent 



.3. 



4. 



^ STOP 
5. A.' L. Richards 
14 Buena Vista Dr. 
milbrae^ Calif. 94030 

». Hayes Real Estate 

2137 Premrose Drive 
' Easton, Lcwisana 70530* 

1, James W. Pinkus* 
• 4431 Mulberry Court . . 
Wndsor, Colpardo 86550 

Cell a C. klefer 
' 2900 Arlington Ave. , 
"Auburn \ "flew Hampshi re 03 

$. J. A. Wagner 
, 2. Rosemary May 
\ Stoney Creek, Virginia' 23802 



s 
s 
s 



0 
D 

0 ' 
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10. Myers Furnace Supply Co. 
: 614 Cliff Avenue - • 

He 1 son George ,3'(Jl 51 

11. Charles E^sel 
306 Clever Drive 



S 
S 
S 



j5 



Deep Run, North Carolina 28525 S 



D 
D 
D 

D 
D 
D 





u 




L« n* uwens 


c 


n 
U 


s 

' s . 


D 




oloO Hoijnes street . 


c 

S • 


D 




D 




Libera', Kansas 76351 




D 


s 


D 










s • 


D 


13. 


Berger Drug Store 


D 


. s 


D . 




6752 Reynold Avenue 




D 








Hay City, low?. 41359 . 


s 


D 




D 


14.. 


Harry J. AndefSJon 


s 


D 


. s 






141 Cheery Way 


s 


D 


s 


D 




Clinton, New York 13323 




ET 


s 


D 














15. 


N.. L. Perry 


S ~ 


bi- 


s' 


•D 




44 Acadeny Avenue 


s 


D 


• S" 


d 




Spring, Texas 73773 


s 


D 


.' s 


D 


16. 


W. R.Gruley 


s 


D 


s 


. D 




2020 Webster Avenue 


's . 


D- 


s 






Eden Hills, Vermont 06563 




D 


S ' 


• D ' 


17. 


* • 

Mary F. Chayis 


> 


D 


s 


D 




20 Cec|er Boulevard 


s 


D 


s 






Richmond, Utah 84433 




D 


2 S 


D ' 


18. 


Fors'Vthff Equipment Company 


s. 


D 



•3 East Orchard Lane 



"S 



Hestland, Mississippi ^39209 S- 
COfiTINUE ON OTHER SIDE 



- D 
D 



19. Ken Dorset Painting 

1020 CUra'- Drive ' S ' 

Palo Alto, Calif., 94302 " S ,^ 

20. Lewis L. Roth S 
'457 3roadv/ay ' S 
Toledo, Ohio 43601 • S 

21. T. R. ThOTOson S 
1713 Bedfo,rd Aven«e S 
Piilladelphia, Perfnsylvania 11904 S 

22. ' Valley Freight Lines " S 

1809 West Carson Street S 
Providence, Rhode Island J)2904 S 

23. William Smith • S 
3266 Main Street , • S 
Dallas, Texas 77521 ' .-S 

24. Gail E. Bate§ S 
197 W. BolTevue Avenue S 
Billings, Montana 59107 S 



Same Different 
S 



D 
D 
D 

u 

.D 
D 

D 
D 
D 

D 
D 
D 

D' 

D 

D 

D 
D 
D 



25. Ernest. Groves 
1216 Royle Road' 
Pheonix, Arizona 85026 

26. Dr. Artur Riley 
P. 0, Box 507 
Zephyhills,,Flortda 33599 

27. Miss Heather Lea 
203 summit Avenue 

^alem. New Hampshire 03079 

28. Brown's Dairy 
16 Race Avenue 

- Elrrwood, Oklahoma' 73539 

29^ John G. ypung 

714 Elysain Street 

Oak Park, Illinois 60301 • 

30. Elizabeth Keenan 
2603 McGee Place 
Madisen, Wisconsin 53703 / 



/ 



Have" you ever had a job on which you were paid 
for doing a task anything like this task? 



□ 

yes 



□ 
No 



for doin^ a task very much like this one? 



Yes 



□ 
No 



(application for services 

"All annlicarits for the services provided by this douurimeut ore r'.qui»*''(I to 
compVit? this application fori.*. Pleaso complete all ite:ns. Do not IpuVg 
any q'Jcst'ons unan^^wered. ^ 

/^PdM/^ ££ji/iL^ £_ 



1 . NaiDe 



2. Addretis 



Last 



First 



fliddlo Iin'tidl 



^Street Number 
3. Social Security Number 
Bl, Male 
Fexale 



Town 



State 



Zip Code 



4, Sex 



(C/iec/c QYd,u one box) 



5. Date of Birth Ji/l/ / I 

Month Day Year 

Education: (C/;ecfe v^^xztk^Jx. i(oa COHPLETEV M VIV m COHPLETE ^di'tQ.vti 
^: 0|$ idxoot In oaQy>tion6 6, 7, and 

Did not 

Conoloted Complete 
or □ 



6. Grade School 

7. Hiqh School 

8. Co'lleqe or University 

9. Currently I an: 
My lasc tv;o jcL s \ 



(C/iecfe oritu o/.c bo/.] 



(Chtck 0}iiif ojte box) 



SI 

BI or □ 

□ .'or oa 

D tmployed 
n Hot Employed 
wore: [Uii cvHAojxt 0-% no6t Ktc^'Xiif hdd joj .^v'^^-J 

Name of Company • Job' Descriptiori or Title 



12 



Name of CoMpony 



Citizenship: 
Kl Am 



14. I 



□• Pin Not 



Job Description or Tiu'tG 



citi.'en oT thsi U.S.A. Cfc/icc..'' cwlu one \'cy.\ 



15-. 



At this time- I -am 



Divorced 

P Hurried □ HidL-./ed 



[Qhtok OKld c:.:- 'c:>k) 
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Directions for Administration 
Comparing Addresses 

Distribute to each person a 3 x 5 card file box containing a set of 
^ cards showing names and addresses for the task, "Comparing A(|dresses." 
There are 4 cards for practice exercises and 26 cards for measuring task 
performance. 

When completed, sa^, '"Each of you has a file box of cards containing 
the. names and addc^sses of persons and companies to whom correspondence is 
being sent. Open the file box and look at some of these cards^ -but do not 
get the cards out of order . • Each card shows the name on the first line. 
(Pause) On the second line is the street address, giving- the number and. 
then the rtame of the street. The third line shows the city address, giving 
the name of the city, the aame of the state and the mailing zip code." 

Now distribute the work sheet, headed "Comparing Addresses," saying, - 
"Here is a work sheet. Write your name in' the space at the top of the ^ - 
page." (Pause) The work sheet has the same addresses as \n the file box 
as copied by -another person. Your task is'to, check whether or not each line 
of the address has been copied correctly. If, the line of the address" is 
exactly the $ame on the card in the box and on your work sheet, you wiVJ 
■put a cross through the "S". If the lines are different , you will gut a 
cross through the "D"." 

"Now^'look at the first card in-your file box. (Pause) It says, >v ^ 
'James Martin,. 114 East Royal Street, -Hadley, Ohio' 44420.-' -Now look at 
the copy of this address on your work, sheet in, the upper left haM corner. 
The first line is- exactly the san^as-in the card fife. Thef^fore^ a 
cross has been put .through the lettei*''S' to* Indicate that the copy'is 
exactly the same ." ' ■ •' * 

"Now look at the street, address. .The copy says '-114 East Royal Street' 
It is exactl/ the' same as in the card file; so again' a mark has been put 
through the letter S. For the city address, the copy shows Hadley, 0/iio, 
44429^, Here the copy ts not the same because the last numbjsr'is different , 
9 instead of zero. Therefore a mark has. been put through D to show that ' 
the copy is different ." 



"Do you have any questions about what to do?" (Answer any questions, 
stressing, that the copy must be exactly the same before the^^ ^s marked.) 

"Now'look at the second card in the card file. (FaTuse) It says, 
'Doctor Ralph Gomez, 2913 Hasbrook Road, Lisbon, M'^ss., 01528.' Now look at 
the second address in the Worksheet. (Pause) The name is RaliSh Gomez but 
the title Doctor has been omitted. So put a cross through the letter D, 
for different , to the right of the name, Gomez." 

"Now look at the next line. Is the street address the same or different 
in the copy? (Pause) It is the same, so put a cross through the Tetter 'S' 
after Hasbrook Road." 

."Now look at the city address. Is it the same as in the card file? 
(Pause) No. Lisbon has been spelled with an 'e' instead of an 'i'. 'And 
. the state has been, spelled incorrectly. Therefore,- put a cross through the 
letter 'D' after the city address." 

, "Do you have any questions about this comparing? (Pause for atfy; ques- 
tions, and answers.) Now complete the next two • cards by putting a cross 
through S or D for each line. Stop after 2 cards. Do not go on^ to number 5. 

-Allow about three minutes for these cards, then say, "Here are the 
answers for these first cards. For card number 3 (pause), R' and P Hastiqqs 
is different - D because the' 'and' is not the same. Their address is dif- 
ferent*- D' because East'is not fully spelled out in the copy. The copy 
address is 'S', the same." ; 

"In card number, 4, the pe'rson's name. Miss Jane Stewart is the same 
so yoU' should have, 'S' after her name. Her addresi is not the -same. The 
word Street is not spelled out fully. Sg a cross goes through -^D' after 
Street. Similarly her s,tate,,New Jersey, has" been abbreviated in the copy 
and'hence.the roa1-k should be different - 'D'.'" " , 

"Do you haye any questions about this task?" (Answer any* questions. ) 
(Pause.) .Now begin^with card number- Sand continue checking until all the 

cards are completed. Do not put any marks on the' cards nor get thetn out 
oTor^eFr^grtniw^ Worksheet and file box when you . 

liave completed the task." 



-ERIC 



Record the starting time. • * . 

If any persons are 'not finished in 18 minutes, ask them to stop. Be 
sure to have them answer the experience questions and mark their papers, 
"DID NOT FINISH". ' ' 



Supplies needed 

For each examinee: 

1 File Box containing the set of cards for the task, 

"Comparing Addresses" (Box also used in Filing Appliance Dealers' Cards) 

1 Comparing Addresses Worksheet 

Front Side - Identification, 4 examples and items i* . la 
Back Side - Items 19-30 
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Name 

Identification Number 





Worksheet 








LUfnrAKiNG TtLtPHONE INFORMATION 






Name 


Address and Telephone Numbers 


Same 


Different 


Brant David W 


182 Hinkel ^d 


X 


D- 




931-499^ 


s 


X 


Briggs John 


600* Cliffside Manor 


s 


D 




761-5760 


s 


D 


Cichoski'lVm P 


3831 Bonaventur Wy 


s 


D 




761-0326 


s 


D 


x:iarke Phillip M 


Hampton Farms Dr 


s 


D 


- 


' 486-2627 

4 


s 


D 


Clem Donald Y 


6 The Knob 


s 


D 




761-5181 


s 


0 


Mazzoni A J 


213 Maryland Dr Glnsh 


s 






486-4635 


s . 


D 


McClaIn Edw J Jr 


55 N Ralph Av 


s 


D 


• 


761-1678 


s 


D 


McClone John W 


330 Escher Rd 


s 


D 




766-/0298 - 


s 


D 


Ifnks Sadfe L 


2645 Brightn Rd . 


s 


D 




776-1759 


s 


D 


Us'sack Edw 


113 1 Av LaOrl Grdns * 


s 


D 


* 


366-2805 


s 


D 


Valetti Gina • 


. 34 Beyl reye Av 


s 


D 




728^2406 


s 


D 


Smith Thos A' 


. 434 Roosevelt Av 


• s 


D 


• 


761-4091' , 


s 


D 


Smith L ^ 


909 CalilFornia Av, 


" s • 


D 




766-8301. 


s 


D 



CONTINUE ON OTHER SIDE 



Name : 



Address and Telephone Numbers Same Different 



Smith R1chd 



325 Ridgewood Av 
913-1357 



S 



D 
D 



Maps tone Dale 



222 Lexington Av 
781-5032/ 



S 
S 



D 
D 



Maloney F D 



4434 Ca/erldge 
781-4^0 



S 

s 



D 
D 



Manor Barber Shop 



Arthur M R 



1122 ^reeport Rd 
781-9838 



7438 Perysvle Av 
761-5466 



S 
S 



S 
S 



D 
D 



17^ 



D 
D 



Backes Gerard 



118 Forllvlew Rd 
486-3456 



S 

s 



D 
D 



Bahorlch Jos L 



Fllegel John C 



1315 Hawthrne 
781-8886 



1000 Greenhlll Rd 
321-0632 



S 
S 



S 
S' 



D 4 



D ; 
D /' 



Folev Wm R 



8886 Perry Hwy 
364-6284 



S 

s 



Fox Chas C 



Potvin Mary 



302 Penn Av 
486-6296 



368 Perry Hyw 
931-6505 



S 
S 



s 
s 



J) 



D 
D 



Printz M R 



Prologo Rocco C 



925 Calif ma Av 
767-3812 



Ruseltn Rd Chswk 
767-4537 



S 
S 



,S. ■ 

S. : 



D 
D 



D 
D 



Reed Thos R 



210 Clalrmont Av 
93T-2809 



S 



D 
D 



Have you ever had a job on which you were paid 
for doing a task anything like this task? • 



□ 

No 



for doing a task very much like this, one? 



□ 

No 



Directions for Adnlnl strati on 
Comparing Telephone^fomatl^ 

Distribute a .Pittsburgh North Suburban Telephone Directory and a copy of 
"Comparing Telephone Information" to each examinee. Then say, "At thie top 
of this sheet, write In your name ahd Identification rtymber. (Pause)- 

"In .this task, the job Is to see If a list of addre^sses and telephone 
numbers are correct by comparing them with those shown In the TelephQne 
Directory you haye been given. Please do not make any marks of any" kind 
In this Directory. Remember, no marks should be made In the Directory." 

"Notice that this list gives the name, address and telephone number' 
for many people. Your task Is to find each name In the Telephone Directory 
and to compare the address and telephone number appearing In the Directory 
with those on the list. If the sets of Information are exactly alike, 
place an 'X' through, the S, for same on your list. If they ara not exactly 
alike, place an 'X' through the D, for 'different'. Do not write anything 
or make any marks In the Telephone Directory . ' 

"To make sure you understand how'to do this task we will work through 
two sample cases. Look at the first sample. The person's name Is Brant 
David W. The last name 1s always presented first. Now open the Telephone 
Directory to\he 'B' listings and find the name. Brant David W." (Pause - 
If anyone appears to be unable to locate the name say) "Brant David W Is 
on .page 20, In the third column. In the lower part of the page." (When 
everyone has found the name say) "The address for Brant David W Is 182 
Hinkel Rd. This J^^exicUy the same as the address on your sheet, so an 
Xhas .been placed through the S. (Pause) The phone number In the Directory 
Is 931-4922 which Is different from' that on the sheet, so the Delias an X 
through It. Are there any questions?" (Pause) 

"Now, look up the address and number for Briqqs John and mark your 
answers for this example. His Information Is on the next page.'* (Pause, • 
allow about one minute.)' 

"The address Is different - D. Perhaps the Directory words are the 
abbreviations for Cllffslde Manor, but do not -guess about'any mlsslncf ""^ 
letters. The Information on your sheet must be exactly like the Directory 
before you mark S for same. 



The telephone number for Bri-qgs is exactly the same, so you should put; 
an X through the S opposite the number. Are there any questions about how 
you check the addresses and phone numbers?" (Pause) 

"Now continue by looking up the information for each of these names. 
Continue' on the other side of your sheet. Remenber.'do not mark anything 
in the Directory. Begin with these nmes now." 

Record the starting time. 

During the Administration, observe whether any examinee is marking in' 
the Directory. Do not allow thisi Any seriously marked up Directories ' 
must be discarded. 

If any persons are not finished in 30 minutes, aslr^theiPEo stop and" 
you mark their paper, "DID NOT FINISH". ^ Be sure to have all ^ersohs 
answer the experience questions. Collect all papers and phone directories. 



Supplies needed fjor each examinee 

1 Telephone Directory (North Suburban - Pittsb urgh) 
1 Comparing Telephone Information Worksheet 




> 
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Directions for Administration 
Copying Telephone Information 

Distribute a Pittsburgh North Suburban Telephone Directory and a copy 
of "Copying Telephone Information" to each examinee. Then sayt "At the 
top of this, sheet, write In your name and Identification number." (Pause) 

- "In this task,- the job Is to copy the addresses and telephone numbers 
exactly as they appear In the Telephone Directory. On the sheet Is a list of 
names. Your task Is to find each name In the Telephone Directory and to re- 
cord the address and telephone number listed. The name in the Directory must 
match exactly the name on the list. After the address and telepl^ne number 
have been found in the Directory t they should be written on the white sheet 
directly across from the name. Please remember do not write anything or 
make any marks in the Directory ." 

"To make surte you understand how to do this task we will work through 
two sample cases. Look at the first sample. The person*? name is Wega 
Harold J. The last name is always presented first. Now open the Directory 
to the 'V listings and find the name Wega Harold J." (Pause - if anyone 
appears to be unable to locate'the name say) "Wega" Harold J is on page 196, 
in the upper part of the first column.? (When everyone hd^ found the name; 
say) "His address is 23 Ravine and'this has been written on your Worksheet. 
Jhe telephone number listed in the Directory for him is 781-4457. Jfris is " 
the number written in the column headed 'Telephone Number^ directly across 
from the name - Wega". " ' 

"Now look up the number for the second sample, Zieqler Albert. Wri te^ 
the address and number on your list." (Pause - if anyone appears to be having 
difficulty say) "Ziegler Albert appears on paeie 206, near the top. of column , 
two." When all have completed the Item or after about 45 seconds say, "The 
address you should write In Is 107 Ivy Rd West View. The number fs" 36"4-0769. 
It should be fe^rded across from Ziegler Albert 5n.the column headed 'Telephoi 
Number'." (Pause) Say, "Are there any questions?" (Answer questions) 

. "It is important that-the addresses .be, copied exactly as gIvenG.- Do not 
fill In abbreviations but, copy them as- priBtedAr*«~~-----^ — 



"Now look up each ia^N these names and copy the addresses and telephone 
numbers listed- beside thfern/t.n the Telephone Dlrector^y. Be sure to look up 
the name exactly as 1t isHlsted. Be" sure to write/as clearly as possible. 
Remember do not make^any marks In' $he/t)1 rectory. Bpgin with these names now.' 



Record starting time. 

Collect the sheets and D^ectorles whw completed, 
tlon, observe whether any 
this. Any seriously marked up 

""finished In 35 minutes, ask them to stop'an^ 
on their Worksheets. Be sure' to Kave alj, pJr^ns 
answer the questlons^n experience. Collect the Telephone Directories and 
Worksheets. . / ■ 



During admlnlstrai- 
?k1nq\the -Directory. Do hot allow 
itorles must be discarded. 



7 



If anv^persons have 
you write (JDID NOT FIn" 



/ 



7 



Supplies needed for each examinee: • . = " 

1 Telephone Directory .(North Surburban - Pittsburgh) 
1 Recording Telephone Infamatlon Worksheet 
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10/25' . , Name 

Identification Number 



Name . 
Wega Ha'rold'j 


Worksheet V 
, . COPYING TELEPHONE INFORMATION 

' Address 


\ 

Telephone Number 




> 


* 


* 

Behr Richard W • 


— - . * ' , 




• 

^Bell Harry R 






Bender Alfred A 






fiennar^do^ Frank A . 






Starr Lawrence 


« 




Staub Wilbert " 




V 


Stanek Jos E 


1 

\ < 




Sprague Wm A 






Phillips LeoJ 


4 




Piotkstfski Edw 






Platts Jas. R 




t 


* 

Platek Eugene 






Gonzales E^dw 






Goston Edw 


r 

\ 


« 


Graham Robt G 


0 ^ ' *\ 




Graziotjt' J 






/ 

Mann. M A 


' ' ' v_ 




CONTINUE ON OTHER SIDE 
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Name 
Marcus Joan L 


Address 


leiepnone nUmDer 


Marker Earl 






Marriner Barry F 






Ritchey Jas E 






Roberts Edqar E 






Roche Jos 


\ - 

V 


* 


Rogers Cyril C 






Kelley Chas E 






Kelsch Jos € 


- - 




Kerr Bruce 


— . — i , ■ . 


c 


Kill en John S 




■■■ \^ 


Die! Miriam 







Dille Guy 







V 



Have you ever had a job on which' you were paid 
,for doing a task anythingTilte. this task? 



Yes 



□ 
No 



for doing a task very much like .this one? 



□ 
No 



( 
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Directions for Administration v * - ^ 

Filing' Appliance Dealers* Cards 

Say to the examinee: "In "this task, you ar^ working with a company 
that buys appliances from many different suppliers. Your job is to keep , ^ 
a file containing the names of the suppliers. Some of these suppHisrs sell 
directly^ to the. public, tKat is, to' Individuals like you and me,, and are 
called, " retailers" . Other suppliers wifl sell only to-other companJes y 
and are called, " whplesajers" . Both these suppliers specialize in selling 
one particular kind of home appliance; for example, stoves, or refrigerators, 
or washing machines or dryers." / ^ • * 

Hand^set of file cards to examinee and say, "Here is^set of cards, ^ * 
ttiat gives information about aach supplier your company works with. Look 
at the first card. It gives tHe name of the supplier, "North- Bo ro*s 
Appliance". It says they sell Dryers - gas and electric. And in the lower 
right hand comer it says they are wholesalers, whick means they sell only 
to other companies. Each one of the cards you have gives this kind of 
information for a supplier." < 

<^i"Your task is to file these cards in a box." (Give examinee a file 
box for 3x5 cahis, -rcontaining ID divider cards, arranged 1ft order as 
follows from front to back: ^ 
Wholesalers , ^ . ^ ' \ 

Stoves ^ • 

Refrigerators • \ 

Washing ftechlnes 

Dryers 

.Retailers ^ 
Stoves- 

Refrigerators . • 

Washing Machines ^ . 

Dryers 

"Look at the fMe dividers that are.ln the box. There are two major . 
sections 1n the file. The first divider "is for-kholesalers. , All suppliers 
who are wholesalers will be filed behind this card. . 



The second section of the file Is for retailers*. Do you see the' 
divider marked, " Retaile r"? , (Pause while It Is found;) All the cards 
for suppliers that are retailers will be filed behind this divider marked 
"Retailer". 

Now look for. a divider marked "DRY£R5".^ You will find on^e for 
Wholesalers and another for Retailers. Suppliers who sell dryers will have 
th61r cards filed behind these dividers depending on whether the supplier 
Is a wholesaler or a retiller. 

Other suppliers sell washing machines and there are dividers behind 
which you will file their cards, depending on whether they should be in 
the wholesaler section or the retailer section. Other suppliers sell 
refrigerators or stoves an^here^ divider cards behind which their 
cards will be filed. \ ' f { ^ 

For a sample exercis^, \it's file the card for Nonh Boro's Appliance, 
the card that ,is on the top of your ^t of cards. (Pause while it is 
located.) The card -says that North Boro^' Appliance is a wholesaler. So 
we know that the card should be filed in the front seption of the file, 
•somewhere' behind the "Whplfsaler" divider. But behind which appliance?. 
(?ause). Look at North -^oro's card to see what appliance it sells. It 
says it sells Dryers - gas and electric"* Thus the card should be filed 
behind , not in front of, the divider for "Dryers" which is behind ''Wholesaler" 
Now -place it i'n your box in the correct section. (Pauses). 

"Do you have aay questibns?" (Answer any questions that may arise.) 

"Now file the next card in your set. It is for the Morris Electric 
Supply Cpmpany. Put it in the rtght section. But do not file other cards 
yet-" (Pause while this is done.) 

"The card for the Morris Electric Supply Company goes in the back part 
of the box behind "Retailer" iind behind the divider for "WASHERS" that is 
in the back part of the file. Be sure to put the card in that section. 
(Pause while t+)is is done.) Are there any other questions." '(Answer 
questions.-) 

"Now, listen carefully . After you have placed each of the cards in 
its. proper place, you will have several cards behind each divider. Eich 



/ 



of these sets of cards should then be placed 1n alphabetical order accortjlng 
to the name of the supplier . If the supplier's name begins vrith A, his 
card will go In front of the c«fd. for a supplier wh;6se name beqine with B 
or a letter later In the alphabet. If t^o suppliers In a set have names 
beginning with the same letter, decide their order by looking at the second 
letter of. theii* names. How remember. ArJ^nge the cards in alphabetical 
order wi thin each set. It will be easiest +f you take one set of cards out 
of the box, put them in alphabetical order, and then place them behind 
their proper divider. Then do each of the other sets in this way. Are 
there any questions about alphabetizing the cards?" (Pause for questions.) 

"All right. Your task is to file your set of cards in ^hf~t)ox behind 
the proper divider. Do each card, one at a'time. Read' the card and file 
it in the proper section. Then be sure to put the cards within each section 
in alphabetical order^ After you have finished alphabetizing the cards, 
raise your hand, and I will come to you to explain what you will need to%o. 
next. You may begin with your cards now. 

Record^he starting time. .Repeat alphabetizing directions to ind^ividuals 
as needed. 

As the examinees raise their hands, check to see if they have attempted 
to alphabetize the cards. Remind them to do this work if it has not been com- 
pleted. Take them a copy of the Recording Shdet, have them write thefr name 
and number on it Sind answer the questions about experience. Collect file boxes, 
dividers and cards. Do not^sk them to record the numbers. 

If any person has not finished filing the cards in 25. minutes, ask the 
person to stop. Give these persons the Recording Sheet. Have tlj^ write their 
name and identification number on .the sheet and answer "the questions on exper- 
ience. Then you should write "DID NOT FINISH" on these Recording Sheets. Col-- 
lect all fiTe boxes, dividers and^cards. 

During the administration of other task measures or after'their adminis- 
tration, record the numbers on the upper right hand comer of the cards on. the 
Recording Sheet as they have been arranged by the examinee.. There are more 
lines than cards .in each division. After the numbers have all been recorded, 
rearrange the cards for. the next administration by placiftg them in numerical 
order from 1 to 58. ^ - , , • 

. ' ' ' ' ■ ' — 

Supplies needed for each examinee: ' • . r 

1 File box containing the set.pf ,58 cards for the task ' . 

"Filing" Appliance Dealers' C3fnds'*(Box also used in "Comparing Addresses"). 
1 set of dividers -(10) "; " 

ErJc ^ ^ii^Qt for recording numbers bf cards in file order. 12 ""5^^ 
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^ame 



•Identification Number 



Filing. Appliance Dealers Cards 



Have you e'ver-ftad a job on which you v/ere paid 

for doing a task anythrijig like the filing which you did? 

\ ^ □ Yes □ 'No 

for doing a task very mudi like the filing which you did? 

□ Yes No 



• WHOLESALE 



Stoves 



Refriperators > Washers 



Dryers 



RETAIL 




.ERIC 
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-Directions for Achini strati on 



Sumniary of Applications 

Distribute a set of Application forms to each person. There are 15 
applications in each set. Also distribute one copy of the "Summary of 
Applications". 

When completed, say, "Each of you has a set of fifteen completed ap- 
plication forms. You may look at them but please do not -get them out of 
order. You, have also been given ,a "Summary of Applications". -At the top 
of this fom write your name af»d identification number in the spaces provided. 
(Pause) When all have completed this, say, "Read the instructions at the 
top of the Worksheet to yourself while I wad them aloud." (Read aloud:) 

"In this task you will prepare a' sumfnary of information from a set of 
Application forms. The names 6f the applicants have 'been printecl in the 
first colCmm below. You are tq record, in the spaces after each name, the 
information requested about each applicant. You will find the information 
you need for completing the summary on the Application forms. Most of the 
information is simply copied but some information must be coded. These 
codes are given at the bottom of this page." (End of instructions on the- 
Summary.) ■ , 

"Now let's see how the information is copied onto the' Summary for the 
first applicant, for Lawrence" E. Brown . T'he applicant's name h^s already 
been co'pied onto the Summary,. The next col um<^ asks for the date.bf birth, 
Look'at item 5 on the Application. (Pabse) fir. Brown's date of birth i?. 
July 12. 1942 . The. word,' "July'.' is not copied, but instead is coded by the 
tablelat the bottom of the page. 'Lodk there: (Pause) July is the seventh 
month. So 2 has been written' under the column headed M-0 for month. Next 
the da^of. birth'has been written, 12. For the year of birth, only the 
last two numbers are used.- For the 1942, only 42 has been written down. 
Are there any questions about copying-the date of birth? (Pause) 

The next column,C, is for recording whe't'fier the person is employed - 
.letter E,. or unemployed - letter U. Look" at item 9-qn Mr. Brown's applica- 
tion. It says he 1s "Not employed".' So ''U"'has been written on the. Sunriary. 
(Pause) . ' ' • . ' 

- . • .12-7 ■ 



The next column, D, asks you to copy the social security number, which' 
Is shown in item 3 of the Application. Mr. -Brown's number is 202-35-8891. 
Are there any questions about copying this number? (Pause) • 

The next column, E, is for recording the highest grade completed. The 
information comes from items six,'sevenj and eight on the Application form. 
In our example, Mr. Brown completed grade school and high school, but did 
not complete college. (Pause) "H-S'-' for high school is written on the 
Sunmary form. he had completed grade school, bu^ot high school or 
college, then G-S for grade school would have been STtten in. Or, if he 
'had completed all three, including college or university, , then C-O-L for 
college would have. been written in Column E." This code Is at the bottom 
of the Sunmary. jPause) 

"MaHtal Status is to be "recorded in column F. This information comes 
from item 15 on the Application, and you. can see that there are four choices: 
Single, Married, Divorced, or WidSwed. Write in the letter S for Single.,. 
M for Married, D for Divorced or W for Widowed." (Pause) Ask, "Are there 
any questions?" (Answer ,iiuestions) 

"Colunn G asks for the zip code of the person's address. Mr. Brown's 
zip code, 88432, near the top of his application, has been copied correctly 
onto the Sunmary." 

"Whether or not the individual is a citizen of the USA goes in. Column H, 
and comes from itenl 14 on the application. Write in "Yes" if the appTicant 
is a citizen, "No" if he is not." (Pause) "Are there any -questions- about 
;copying or coding any information? (Pause and answer questions.) 

"Now begin filling in the Summary form for the second application. 
Be sure and use the 'correct codes and write legibly and clearly. Work as 
quickly as yott-can biit without snaking mistakes. ' Do not omit any information 
in the cplumns. when you have'comtjleted the' Summary Sheet for all 15,app.li- , 
cation fomfs, raise your hand and i will pick lip your material." ' Record - 
the starting time . As persons finish, be sure to have ^hem turn over'the 
Summary and answer the questions about experience. " 

If any^ persons are not finished in-21 minutes working time, ask them 
to stop. Be sure to have them answer the experience questions and mark 
their papers, '.'Did. not finish". . ' 



Supplies -iieeded 

For each 'examinee: ' ' • 

1 set of Appl ideations (.15 each) 
' 1. Summat7 of Applications ' -'.128 
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Have you ever>hacl a job on which you were paid 
for doing a task anything like this task? 



41^ 



for doing a task very much like this one? 



i'30 



Application for services 



All applicants for the services provided by tbis department are required to 
complete this application form. Please complete all items. Do not leave 
any questions unanswered. 



1 . Name 



Last 



^ First Middle Initial 

Address 

street Number Town State . Zip Code , 

3. Social Security Number J^^Jl " ^ ^ S'v/ . , . 

0 Male 



4. Sex 
5. 



12. 



[Chzck onlu one. box) 



C3 Female 
Date of Birth Jt/^/l /JL. / /9^2 ^ 



-Month ■ Day Year 



Education: [Zkzok wk(>theA you COHPLETEO OR VJV NOT COf^PLFTE ejzch Z&veZ 
6|J idiool In qixQMtU}Y\& 6, -7, a.nd 

Did not 

CompT&t^d Complete 

0 or □ (C/iecfe -onlvi one box) 

B ' or □ 



6. Grade Schodl 

7. High School 

8. College or Univel"sity 



9. Currently I am: 



10. 



i>3 

{C/iecfe OYiiJi am box 



iCkzcJi ontif am. box) 
{Ckzck onlii one, box] 



or 
or 

□ or 

n Employed 
S ~ Not Employed 
My last two jobs were: [LUt cuAAznt ofi molt fiQXiQjvtly hzld job ^lut} 

Name of Company > '* Job Description or Title 

Name of Company . " Job Description or Title 



14, I 



Citizenship: ^ ; 
IS Am ' 

□ An Not 



a citizen of the U.S.A. 



[Ckzok oydAi one- box) 



15, At this time I am 



□ Sip^le . □ ^ Divorced 
Married . ^^liJ V/idowed 



[ZkiiQic dntui one pox) 



Directions for Administration 
, DETERMINING HOUSING QUALIFICATIONS 

Distribute to each. person a copy of the "List of Housjng Applicants.!.' 
Each Listing is for a family, and contains a brief description of family 
size and family income. There are two listings for practice- exercises and 
23 listings for measuring task performance. 

When distributed, say, "Each of you has a List of Housing Applicants 
containing the names and personal information about families' who are applying 
for low rent housing. Each listing gives the name of a family on the first 
Tine. (Pause) Next there are sentences which give you the information about 
the size of the family — that is, the number of persons in the family — and 
the total monthly income of "the family. rou Avill use this information about 
family size and total monthly income to decide whether or not each family is 
qualified for low rent public housing. And, for those families that are 
qualified for this housing, you will also determine the size of the apartment 
for which they are qualified." 

Now distribute the Worksheet headed "HOUSINfi OUALIFIC/VTION WORKSHEET" 
and sayi 'IHere is a Worksheet you will use to do this task. Write your name 
and ,identifi cation number in the space provided at the top of the page." 
-(•Pauae, and when completed, sa.y) "Now, read the instruction^ at the top of 
the page to yourself while I read them aloud." 

- INSTRUCTIONS 

(Read Aloud) , • . ' • 

"Low rent public housing is available for. individual? and families with 
low incomes. Monthly family income and the size of the family determine 
whetherNjr not a family is <iualified for this housing, and if qualified, the 
size of tlWIipartment they may rent." • \ : ' • 

Look at the table below which gives the information you v/ill need, to 
make decisions about each case. ' 
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Housinj Qualifications Table 




Number of 


l-JjlA 1 inuiii 




Size Apartment 


rersons in 


Monthly Income • 




Tor wmcn rami ly. 


Family 


Allowed 




Ts qualified 


1 


$400 • 




; ^ ^ — 

tfticiency iutti 


2 


$500 




• 1- Bedroom (1 BR) 


o 


^ $550 




/: Bedrooms \L oR; 


4 • 


$600 




2 Bedrooms (2 BR) 




$650 




0 Dedrooms \6 dK; 


6 • 


^ $675^ 




3 Bedrooms (3 BR) 


7 


■/ V $700 




4 'Bedrooms (4 BR) 


8 or more 


$725 




4 Bedrooms (4 BR) 



(Not 
an 

Official 
Table) 



(Pause — allow everyone tq locate and look at the table for a moment.) 
Then say, "To make sure everyone know*s how to use this table and to fill 
out the worksheet we will do two, examples together. Look at the description 
of the first, family listed. „ The name of the first family is ALVAREZ,- 
Frederick E. (Pause) Read about his family to yourself whiles I ^^ead aloud.^ 
(Read Aloud) ; . - ' 

ALVAREZ, Frederick. E. ^ , ^ ^ ^ 

Mr. Alvarez is married and has two daughters, Emilia, age .8 ^ \ ' 
and Frederica, age 4. He is employed as a carpenters helper 
and earns $525 per month. 

Say, "Now look^at^yoyr Worksheet.^ At'the middle of the 'page on the left 
hand side fijid the name ALVAREZ." (Pause — make sure everyone^ finds the 
right place on the worksheet.) *'"Looking across the Worksheet you can see " , 
.that there are four questions to be answered about ejach family — the number . 

■ 'of persons in the family, the total monthly family income, is the family _ 
qualified for low rent housing?, and the iize apartment for which the family 1s 
qualified? ,lx\ order to answer the first question you must looH at the 

. descrip'tion.of his family and decide hmv many persons are In the family. 
(Pause) There are four people In the Alvarez family, and you wfll notice , 
tHat the number '4' has been written in on the worksheet next to the name 
Alvarez. (Pause) Does everyone understand how^wjei determined that there are' 
four people ih^thfi Alvarez family?" (Repeat the explanation above if there 
are questions.) ^ . . ^ 



Saiy, "Mr, Alvarez is employed as a carpenter's helper and earns' $525 per 
month. This has also been written in on the Worksheet, in the second" space 
.beside Alvarez's name,". (Pause) "The next step is to decide whether or not^ 
the Alvarez family is qualified for low rent 'housing. To decide this we 
must use the table that is printed on the Worksheet," (Pause — point out 
the table,) "Look down the left hand column for the number*^ of persons in 
the family. Find the number '4'," (Pause) "In the middle column, the ' ' 
maximum monthly income allowed for a family of four is $600. This ipeans ' 
that any family of four persons that has a total monthly- income of $600 or 
less is qualified for low rent housing. Since the Alvarez family income is 
only $525, they are qualified for low rent housing. On the Worksheet an 
,'X' has been writtea before Yes_, If the Alvarez family inc)!^i^had been more 
than $600, say $625, they would jiot^ qualify and il^viould, have been checked. 
Are there any questions?", (Pause) 

^ "Nov/, the flnaVitem on the VIorksheet deals with the size of the apart-, 
ment for which a family is qualified. It is the number of persons in a 
low income family which determines the size of the apartment they may have. 
.The table sa,ys if there is 'just one person in a family, he or she may rent 
an" efficiency apartment. Tv/o-pers,on families may rent a one |)edroonT apart- 
ment. .If a family consists of either three or four persons they may have *a 
tv/o bedroom apartment, and so on; The largest apartments have four bedrooms, 
and to qjiaTify for one of these, there itiust be at least seven people in the 
family." . • ' ' 

"The ATvarez family consists of four people, and since their total income 
qualifies them for an apartment, they are qualified to rent a two bedroom 
apartment. On the Wbrksheet ^ 2 BR' has been circled tp in<iicate* that tK$y 
qualify for a ,tWD bedroom apartment. Are there aoy questions?" (Pause) 

Say, "Let's do one more example. Look -at the second listing, tl 
far the CHAVIN fartiily."- (Pause) Read aloud^ "CHAVIN, William R. f^. Chavin 
Ms single, but suppqrts^ both parents who live with him. If qualifiea for 
public housing. Mr. Chayin's parents wtll continue to live with him.' His in- 
come 'is $400 a month as an apprentice tailor. With-his fatheV's pension of 
$175 a month, the total family income is $575 ^er months" (Pause) "On the 
Worksheet there has .been written that there are three people in this family 
and the TOTAL family .income ,fs $575," (Pause) " ^'The income for this family 



of three is more. than the ipaxlmum of $550, Therefore they do not qualify 
for low rent housing and No has been checked on the Worksheet," (Pause) 
"If a family does nonqualify for this housing, then they "do not qualify 
for an apartment of an);, size and ' None ' should be circled," (Pause) "Are 
there ai?^) questions before We go on?" (Answer questions and then say:) 
"Now fill in the worksheet fbr each family. Do all the items for one family 
before going oh to the next one. Work right dov/n the page and then do the 
items on the back. Work as quickly as you can without making mistakes. 
When you h.ave completed all the items, put your pencil down and I will pick 
up your Worksheet, Write only on the Worksheet; do not write , /or make any 
marks. on the Listing," (Pause) 

When everybody i$ reacjy, .say,"Begin working now," Record the starting 
time, : 

As individuals finish, remind them to answer the question about ex- 
perience. Monitor the session closely to make sure individuals do their . 
own work. If .any persons are not finished in ^ minutes working time, ask 
them to stop. and mark'their papers "Did. not finish,_J'' Be sure, however, to 
have these persons answer the questions on experience .' Collect all material; 

\ : ' 

Supplies nejeded 

For each examinee: , 

1 List of Housing Applicants 
1 Housing Dual iff cation Worksheet 

. . Front Side - Instructions, 2 examples, and items 3 -12 
Back Side - It^ms 13 - 25 




•LIST OF HOUSING APPLICANTS 



1. j\LVAREZ, Frederick E» Alvarez is married, and has" two daughters: 
himna, age a ana hj^deri.ca, age 4, He is employed as a Carpenter's helper' 
and earns $525 per month, 

2. CHAVINj William' R. — Mr. .Chavin is single, but supports both parents who live 
with him. If qualified' for public housiVig Mr, Cfiavln's parents will continue 

„' to live with- him. His income is $400 a month as an apprentice tail or, I'lith 
his father's pension' of $175 a month the total family, income is $575 a month, 

3. CLARKE, Helgn E. -'- Ms. Clarke is divorced, and has i?>io daughters living with- 
■ . her. Her total monthly income. Including child support from the children's 

father is $480, She is employed part-time as a waitress, 

4. DORSE Y. Re agin J. ~ Mr. Dorsey is j^arried.and has two children: Reagiri Jr,, 
age 6 and Samantha, age 5. [Irs., Dorsey 's mother also lives with the family. 
Hr. Dorsey works as a shoe repairman. The total monthly family income- is $675. 

5. ESSEN, Ellen E. — Singlei f-ls, Essen lives alone and works as a clerk-typist, 
earning $395 a month. . '- " , 

6. ." FARR. John C. Widowed, Mr. Farr is retired and living. on a monthly pension 

of $430. , • . , 

7. GUNTHER^ Allan B> Mr* and Krs» Gunther have 5 children, ranging in age from 
3 to 16* Mr. Gunther is employed as a welder, with a monthly salary of ^650. 

8. HALSTEAD^ Els a ~ Ms. Halstead lives with her mother and her aunt. Each works 
• and^the total family income is $925". 

9. Pinkster % Roland — Mr. and firs. Inkster have no children. He is a disabled 
veteran and collects a disability pension of $250 a month. With Mrs; Inkster's 
salary as a part-time sales clerk the total monthly family income Is $425* 

IQ. JONES'^ Ernest P . — In acidition to his wife, Mr. Jones lives vnth and supports^ 
theif four children and hfs parents. The mont{jJy family income is $720. 

lU J(ERt^IT^ Ami! — The Kermit family consists of Mr* and Mrs. Kermit and 4 ?bns 
laged 9 to, 15. His monthly income is $695. - - ; 

12. n LANGLEY,^ Ruth ~ Miss Langley and her sister live together. The total monthly 
' income for this family is $480. ^ ' . \ * 

13. MONTAGUE > Robert T« — Mr. and Mrs. Montague have.three^ children living at 
home.,^ The total monthly family income is $610. 

lAm . NAPIER> Arnold — Mr. and Mrs. Mapier have s'ix childt;«n ranging in age from 
. 1 year to 15 years old. Mr. Napier ns employed as a v/aiteir, having a monthly 
. income of $715. \ . 

15. OLSON > Glenn — Mr. Olson is single. /His monthly income*is $495 as^ a parking 
lot attendant. - . . " 



CONTINUE ON REVERSE SIDE 



16, OSWALD, Mildred — Mrs, Oswald, a ^fidow, supports her tv/o children on a 
monthly income of $450, 

17, PARIS, Widred r4s, Paris eanis $475 as a clifk-typist. She supports ' 
nersfelf and ooe daughter on this salary, - , • . 

18, PRETT. 'John — Mr, and Mrs,..Prett have three children, Mrs, Prett earns 
5200 a tnonth as a part-time hospital aide," Mr, Pt^tt earns $400 a month 
as a ^les c"Tcrk, The total family income is $600 a. month, 

19, RILEY.. Alan — "tlr. Riley is married and they have one child. His monthly 
■ salary as a cook is $580, 

20, RUDDj. Martin — The Rudd family 'consists of Mr,' and Mrs, Poidd, both of 
Mr, Rudd's parents, and Mrs, Rujdd's mother, Jhe-feotal family income of 
$700 comes from Mr, Rudd's monthly saTTwr^$550 and his father's 'monthly 
pension of $150r •• — ^ 1. ' 

21, THOMAS. Henry — Henry Thomas is married. The Thomas family's monthly . 
incoma is $525, primarily from his job as a salesman. 

22.. TILLY. Virginia — Virginia supports herself and two ydunger sistef^. She 
works as a legal secretary and has a monthly salary of $515. ^ 

23. ULLAND. Hans — Mr. Ulland is married. He and his wife, have seven children 
living at home. His monthly salary as , a salesman is $710. ■ 

24. HERfjER. Edv/ard — The Werner 'family consists of Mr., and. Mrs. Werner, and 
their tv/p, children. Working as a construction laborer, Mr. Wemer''s monthly 
salary is, $530. . " - 

25. ZUNK. Guthrie — Wr. Zunk is single and works as a shipping clerk. His 
monthly salary is $390.. * • • 



Name 



HOUSING OUALIFICATlaN WORKSHEET 
<— 

I den tifi cation Number 



INSTRUCTIONS 



Low rent public housing is available for individuals and families vn'th 
Im-/ incomes. Monthly fiimily income an4 the size of the family determine 
whether or not a family is qualified for this housing, and if qualified, the 
size of apartment they may -rent. 

The table below gives the information you will need to make decisions 
about each case. 



Name 

ALVAREZ 

CHAVIN 

clari<:e 

DORSEY . 
ESSEN . . 
FARR 
eUNTHfR 
HALSTEAD ' 
INKSTER 
JONES'. 
i^Rf'lIT ' 
LANGLEY • 





Housing Qualifications Table 




Nunter of ■ 


Maximum 


Size Apartment 


Persons in 


Monthly Income 


for which Family 


Family 


Allowed 


is qualified 


1 


$400 


Efficiency (Eff)^ 


. 2 


$500 


1 Bedroom (1 BR)y: 


3 


$550 


2 Bedrooms (2 BR) 


• 4 


$600 


2 Bedrooms (2 fiR) 


5 


$650 


3 Bedrooms (3 BR) 




$675 


3 Bedrooms (3 BR) 




. $700 . 


4 Bedrooms (4 BR) 


8 or more 


$725 ^ > 


4 Bedrooms {4 BR) 




Official 
Table) 



Number of 
Persons in 
Family 



Total Monthly Is this Family 



Family 
Incomfe 



$ 



% S7S 



0 



$_ 

$ 



Qualified for 

Lctv Rent Hou^ncj? 
--^r — a_ 

. X Yes _^ No 

; Yes _X. "0 

Yes No 

yes No 

Yes . No 

... Yes No 

Y,es No 

Yes No 

■ Yes ^ No 

Yes No 

■ Yes _^ No 

Yes No 



For What Size Apartment 
Does the Family Qualify? 



Eff IBR QB3; 3BR 4BR 

Eff IBR 2BR 3BR 4BR 

Eff IBR 2BR 3BR 4BR 

Eff IBR 2BR 3BR 4BR 

Eff IBR 2BR 3BR 4BR 

Eff ifeR 2BR 3BR 4BR 

Eff IBR 2BR 3BR 4BR 

Eff IBR 2BR 3BR ^BR 

Eff JBR 2BR 3BR 4BR 

•Eff iBR 2BR 3BR 4BR 

Eff IBR 2BR -3BR''~4BR 

Eff IBR 2BR 3BR 4BR 



None 
^on^ 
None 
None 
None 
None 
None 
None 
None 
None 
None 
None 



y ^.CONTINUE ON REVERSE SIDE) 



13* 
14. 
15. 
16i. 
17. 
18. 
19. 
20. 
21. 
22. 
23. 
24, 
25; 



Name • 

MONTAGUE 

NAPIER 

OLSON 

OSWALD 

PARIS 

PRETT 

RILEy 

RUDD- 
THOMAS 

TILLY. _ 

ULLAND", 

IfRNER 

ZUNK ■ 





Housing Qualifications Table 




(lumDer ot 
Persons in 
Family 


f^imum 
■ Monttily Income 
Allov/ed • 


Size Apartment 
for v/hich Family', 
is qualified 


1 


$400- 


Efficiency (Eff) 


2 


SSOO 


1 Bedroom (1 BR) 


■ 3 


$550 


• 2 Bedrooms {2 BR) 


4 


$600 


2 Bedrooms (2 BR) 


5- 


$650 


3 Bedrooms (3 BR) 


6 


$675 


■ 3 Bedrooms (3 BR) 


7 


$700 


-4 Bedrooms (4 BR) 


8 or more 


$725 


4 Bedrooms (4- BR) 



Number of 
Persons in 
Fami ly 



Total Monthly 

Family 

Income 



$^ 
$, 
$. 

S. 

$. 

$, 
$. 

$, 

$. 

$. 

$. 

$. 



Is this Family 
Oualified for 
Low Rent Housing? 



Yes No 

Yes No 

Yes -No 

Yes No 

Yes ' -No 

Yes ."No 

Yes No 

Yes No 

Yes -No 

Yes No 

Yes . _No 

No 



For What 
Does the 



Size Apartment 
Family OualifvT- 



Yes 
Yes 



No 



Eff IBR 2BR 3BR 4BR None 

Eff IBR 2BR 3BR 4BR None 

Eff - IBR 2BR '3BR 4BR None 

Eff IBR 2BR 3BR 4BR None 

Eff IBR . 2BR 38R 4BR None 

Eff IBR 2BR 3B4^ 4BR None 

'Eff IBR 2BR 3BR 4BR None 

Eff IBR 2BR 3BR 4BR None 

Eff IBR 2BR 3BR 4BR None 

Eff IBR '2BR 3BR 4BR None 

Eff IBR. 2BR 3BR 4BR NjDn,e 

Eff IBR 2BR 3BR 4BR None 

Eff IB'R 2BR 3BR -4BR None 



Have you ever had a job on which you-were paid for doing a task 
anything fike this task? 



' □ Yes □ No ■ 

for doing a ts^sk Very much like this one? 

' - D Ves □ Vo 



ERIC 



. • . ' • 10/17/74 

Caljulating Postap Charges 
V Dfrectlons 'for Administration' . 

Distribute copljBS of "Calculating Postage Charges" and pieces of • 
scratch paperT Say, "In this task the jolx Is to calculate the postage 
charges. At -the top of the page Is given the postage rates, f^ote that it 
shows the kind of mall and the cost per ounce or per plece^ 'It shows that- 
for first class mall the cost Is $ .10 per ounce; for single post cards It . 
costs $ .08 each-; for double post cards the cost Is $ .16 each; for air mall 
letters It costs $ .13 for each ouncefthe letter .weighs ." 

"It also shows the additional fees or cost for two extra services. 
Each ?etter or card sent by special delivery costs sixty cents extra. Each 
letter sent by certified mail .costs thirty cents more." - 

» * . - . ^ 

"Below these rates is shown Monday's mall and how the cost was fiqured. 
Let us look at these examples. First there is the first class letter. Each 
piece weighs two ounces. The table at the top says that each ounce of a 
first class letter costs 10 "cents. So a- two, ounce' letter costs 20 cents. 
This has been written in the "next colunn under "Cost -per Piece". 

"Thehe are two first class letters of t^iis kind, so 2 times 20 cents . 
Is 40 cents and this "has been written in the column under "Cost". 

"Now Monday's mail also Included air malT letters weighing 3 ounces 
each. An.air mail letter costs $ .13 per" ounce, so 3 ounces would cost 
$ .39 and this has been written in the column headed "Cost per Piece". The 
next column says there is one such air. mail letter so the total cost in the 
last column to the- right is thirty nine <:ents-." 

"Now look at the next mail for Monday. There are double post cards. 
The ounces or weight is not Important but our table at the top of -the page 
shows that it costs '•'9'* each double post card. But tn addition the 

cards Ijave been sfent by s^itial "delivery, >^h1ch costs sixty cents each. 
So the total cost .for a special delivery double post card is seventy-six 
cents. So 76 cents has been .written -^n the coJimn, "Cost per Piece". The 
number of double post cards is 10 sc^that the total- cost in-the right hand 
coliirin Is 10 times ^6 cents or seven dollars and-sixty cents. You can use ' 
the scratch paper ^or your calculations," 



"The next part of the ^tonday's mall Is single, post cards. Again ounces 
are not Important but the table at the top of the page shows that eac'h single 
post .card costs $ .08 each. But In addition the cards have Ijeen sent by 
certified mall, which costs thirty cents more. So the total cost for each 
certified single post card ts thirty eight cents. For five such cards, 'five 
times thirty eight,' Is one dollar and nltiety cents." 

"That Is all the mail- for Monday 'so the column for "Costs'i-has been 
added. These numbers are 40 cents, 39 cents,' seven dollars and sixty cents, 
and one dollar and ninety c^ntsj^heck this adding. (Pause while this ad"-" ' 
ditlon Is checked.) Yes, thes^inn&&<s add to ten dollars and twenty nine 
cents . " . ' 

« 

"Are there any questions about , how the. postal charges for Monday's maiT 
were calculated?" (Pause to allow questions to be raised and answered.) 

"Now figure the costs, for Tuesday's mall. Note that there are four dif- 
ferent types of .mall on Tuesday. For each one write In the cost per piece, 
and then the total cost for those pieces. Finally add the charges to show 
the total cost of Tuesday's mall, but Jo not go on to Wednesday's malK" 

Allow^about 5 minutes for the examinees to work on the calculation, of 
the cost for Tuesday's mail and then say, "Now let's work through how ybu. 
would calculate the cost of Tuesday's mall. First look at the air mall lette 
each one weighing 2 ounces. Since It costs 13 cents for one ounce., 2 ounces 
would cost 26 cerits each. There are three such air mall letters, each, 
costing 26 cents, so that the total cost written In the right hand column 
should be 78 cents." • ' 

, "Th6 second part of Tuesday's mail Is a one dunce first class letter, 
special delivery. This would cost 10 cents for the letter plus sixty cents 
for special delivery. So you should write In 70 cents In the. third column. 
It says that^ eight such letters were mailed, ^ight times 70 cents Is five / 
dollars and sixty cents; write this In the right hand column." 

"The next mall is certified first class letters each weighing 4 ounces. 
The cost per piece Is 40 cents plus 30 cents, a total of 70 cents. Write 
that irl the column under "Cos^ per Piece". There are four such pieces s^o 
that the cost In the Hght hand column should be four times 70 cents or two 
dollars aad eighty cents." 



"The final mail for. Tuesday was double DOst cards. The cost pgr piece 
is 16 cents each. Write 16 cents in the third column. There were two double 
post cards mailed Qn Tuesday^ Two times 16 cents is 32 cents. Write this 

in the right hand column. V . ' 

*i ' . . • 

"Now add the four numbers in the right hand. column, (Pause) The 

total of these numbers is nine dollars and fifty cents. Are there any 

questions how the cost for the nail for each day is calculated?" (Pause 

for any question's and answers.) 

"Now begin to calculate Wednesda^y^s mail and then Thursdaiy's mail 
and when this is completed, continue on the other side, calculating the 
mail costs for each of. the other days shovhi on the other side* Begin nov/." 

If any persons are not completed in 30 minutes, ask them to stop and 
you record "DID NOT FINISH" on their papers. Be sure that all persons 
answer the questions^ on experience.' Collect all sheets and destroy the 
scratch paper, ^ , ' . ^ . ' 



Supplies needed 

' For each' e/aminee:. 

1 Calculating Postage Charges Worksheet 

Front Side - Postage Rates, 2 examples and 2 items 
^ Back Side*- 3 items^ 
. 1 piece scratch paper ^ * 



Name ■ 

Identification -Number 



WORKSHEET 
USINR ZIP CODES' 



Exanples City 

Bellwood (16617) 
Bolivar 



Airline 
Braniff 
American 



Flight Number 



Flight Numbers. 



Airline 


0 


.157- 


159- 


164- 


166- 


177- 


179- 


180— 


188- 


1. Allegheny 


414 


442 


416 


462 


471 


719 


810 


818 ' 


2. American 


875 


820' 


846 


616 


741 


917 


801 


186 


3. Braniff 


517 


571 


641 




174 


197 


186 


168 


4* Commuter 


751 - 


195 


461 


466 


774 


710 


108 


381 


5. Delta 


365 


424 


.369 


641 


147 


97V 


188 


116 


6. Eastern 


175 


157 


146 


168 


614' 


791 


681 


881 


7. Northwest 


159 


165 


167 


468 


179 


149 


214 


368 


_8. TWA 


571 


519 


466 


186 


797 


177 


848 


183' 



Zip. Code 



^Flight 
lumbers 



STEPS 

1. Look in the Directory for the zip. code number for the city and remember the 
firs£ three numbers. 

2. Find in the Table the colunn headed by those three nuirbers. 

,3. Look down, the column until you are across from the name of the 'airline 

' serving that city. 
4. Copy the flight number in that box onto the line across from the city. 



Cherry vjlle 


Eastern 


Coral 


Allegheny 


Cass vi lie ' 


Northwest 


Dunlo 


Commuter 


Friedensburg 


TWA 


Hjarford 


AmeH can 


East Springfield 


Braniff 


Eagles Mere 


D6lta' 


Limeport 


Allegheny 


Home 


Eastern 


Loysburg 


American 


Lilly. . . 


Northwest 


Middleport. 


Delta 


Jackson 


Eastern 



143^ 



continue on other side. 





At rl 1 no 
rv i I 1 1 lie 




7 • » - 




- 


,1 

I 






157- 


159— 


164- 


166- 


177— 


1 7n 

179— • 


180— 


188-- 1^ 


1. 


Allegheny 


'414 


442 


416 ' 


-462 


/! 71 
4/1 ^ 


7 1 n 

719 


810 


818 


"'2. 


Amenican 


875 


.820 


845 


616 


7>!1 

74 1 


m 7 

917 . 


801 


186 


3. 


-Braniff . 


,..517- 


571 


641 


■'521 


1 7^ 

1 /4 


1 07 




168 


4. 


Coirmuter 


751 


*195 


461 


466 


77A 
/ 






j8i 


5. 


Delta^ . 


•365 


424 


•369 ' 


641 


147 , 


•971 


•188 


116 


6. 


Eastern 


175 . 


157" 


146. 


168 


614 


791 


681 . 


881 


7. 


Nbrthwest 


159 • 


165 


167 


468 


179 


149 


■214 


368 


8. 


TV/A : 


rsji 


■519 


4!5.6 


. 


J?7 


177 


848 - 


183 - 



'Airline 



Linp^villo N 

uiiicoVIIIC 


Commuter 


Lindpn 


American 


PonncKiiv*n 
.r ciinbUUrQ 


Conmuter 


111 Cn uOwn 


Braniff 


Morann 


Commuter 


iianty bio 


Eastern 

< 


new rii 1 1 due 1 pm a 


American 


Rome 


Allegheny 


Saegertown ^ 


Eastern 


Shunk 


Northwest 


Riegelsville 


Delta 


Northpoint 


TWA 


Riddles burg 


Eastern 


Robinson 


TWA 


Sacramento 


Braniff 


SpfiTigville^ 


Braniff 


Venango 


Northwest 


Trout Run 


Braniff 


Sunneytov/n 


TlM 


Starford 


Commuter . 


Westover 


Allegheny 



Have you ever had a job on which you were paid 
for doing a ^task anything like this task? 
. Yes □ , No □ 



Flight Number 



Zip Codes 



Flight 
Numbers « 



for'doing,<a task very much 
this one? :yes □ No □ 



like 



14 I 



Directions for Administration 
- Using Zip Codes 

Distribute to each examinee a copy of the Pennsylvania Zip Code Directory . 
and of the Zip Code Worksheet. Say,' "In this, task you are worl(ing in a mail 
room, helping to send the airmail out on the proper airline and flight number, 
you afe given the name of a city and~the Airline that carries mail to that 
city. Then, use the Table on your Worksheet to find the flight number. Let's 
do the first-example: /(pause) Bellwood City served by Braniff Airline. The 
example shows' the zip code"' is 16617, The first three nunbers are 166. So 
look in the table at the column headed, 166-dash-dash. (Pause) Does anyone 
not see that column heading - 166?" 

After'questiorts, say "Now look down the column until you are on the line 
far Braniff Airlines. (Pause) Th^e number in the column across from Braniff 
is 521. ' It has been circled to help you. The flight number, 521,, has been 
written oh the Worksheet across from the' city, Bellwood;" ^ 

Now let's do the second example: BoliVar, served by American Airlines. 
The zip code is not given, so first you will have to, find it in the Zip Code 
Directory you have been given. Find Bolivar in your Directory. It is on the 
first page of cities. (Pause for examinees to find the nunter.) 

"The zip code for Bolivar is 15923 . Now look in the Table in the column • 
headed 159. (Pause) Lopk dov/n this column until you are across from American. 
The flight number is 820. So write 820 on your Worksheet on the* line for 
Bolivar." (Pause) ' > 

"Read the steps be'low the Table which review hov/ you are to find the 
flight number for each city., ^ 

1. Look in the Directory for the zip code number fqr the city and 
remember the first three numbers. ■ 

2. Find in the Table the column headed by those three numbers. 

3. Look dov/n the" column until you are across^ from , the name of the 
airline serving that city. - 

4; Copy the flight number in that box onto the line across from the city. 

"Are there any questions about )this task?" (Pause and answer questions). ^ 
Begin with the list of cities and continue on the reverse side. Do not put 
any marks on the Directories." • . , 

Record the starting time. * ' 

If any person has not finished in 40 minutes, ask the person to stop-and you 
wrtte "DID NOT Finish'; on* their; worksheet. Be .sur&^to have 'all persons answer 
the questions on experience. Collect the Zip Code Directories and Worksheets. ^ 



Directions fdr Administration 
Personnel Report Information - . 

^ • 

Distribute to each examinee one copy of the "Information Worksheet" 
with the. side up showing spaces for Name, and say, ."As soon as you receive 
this paper, write your name and identification number on the front, but do not 
turn the page over until we all are ready for it. 

Distribute copies ci^the "Personnel Report - .Accounting Department", 
one form to each examinee. Then say, "In this task you a.re working in a 
Personnel Office which has records about each employee. You have been 
given a copy of the personnel report prepared for the Accounting Department . . 
Look at the headings across the top. Note that it shows (slowly) the name ' 
of the Employee, the payroll number, the job title , the age, the annual 
salary, the sex - M for Male and F for Female, and the'number of month's of . - 
service - the length of time the employee has worked in the company. This 
information is given for every employee in the Accounting Department." ' 

"Look at the first line of the report.. It. says that "(slowly) Eleanor 
Cain, (Pause) has payroll number 18642, has a job title of Accounting Clerk , 
is 22 yeai^s old, earning a salary of $6,080. The F shows she is a female, 
and she has Jl months, of service with, the company." 

"Assume that "as part of your work, various people call you on the 
phone and ask you questions about the Accounting Department. To answer the. 
questions you need to look in this Personnel Report.. Some examples are 
shown on the page with i^our name. Look at the examples at the bottom of the 
page. Example 1 asks: Whc»t is Mr. Hall's first name? Look on the Personnel 
Report under the column headed Name . The first name is Eleanor Cain . The 
.next name is Leroy.'fcampbell . Next is Gordon Hall . Mr. Hall's first name is 
"Gordon". To answer the question, write I'Gordon" in the space for Eo<an1ple 1." 
(Show where it is located.) - '• 

"Look at the second example: How many stenographers are in the Accounting 
Department? Look in the cojKimn headed "Job Title" until you come to the job 
title. Stenographer . We see^here are four persons in the position of Steno- 
grapher. So, write the number, on the 1ine>or Example 2." • (Show where 
It is located.) 



"On the back of this page fs a list of some of the questions you might 
receive. Read each question very carefully . Find the answer in the Personnel 
Report, and then write the answer beside the question. For some of the ques- 
tions, you will need to dp some arithmetic. You may use the margins or the 
other side of the page to perform this arithmetic. Be sure to put your 
answers In the spaces provided. All the information you need is in the 
questions or in the Personnel Report. Are there any questions? (Pause 
and answer questions.) Turn over the page, and beqin to answer the questions." 
( Record the startinq time .) 

As examinees complete their work, remind them to complete the experience 
questions. If any persons are not finished in 25 minutes working 'time, ask 
them to stop and you mark their papers '*Did not finish". Be sure, however , 
to obtain their answers to the experience question at the bottom ^ Collect 
all Information Worksheets and Personnel Reports. 



Supplies need&d 

For each examinee: 

1 Personnel Report^- Accounting Department 
1 Information Worksheet 

» 

Front Side - Identification and examples 
-Back Side - Questions and answer column 



PERSOHNEL I^EPORT * ACCOUNTING TJEPARTHENT 
Report for ^tonth of September 1574 



10/74 



NAME 



Eleanor Cain 
Leroy Campbell 
Gordon Hall 

the 1 ma Hayes 
Jerome Kirk 
Elaine Lazeroni 

Lynn Curtis 
•Paul Esposlto 
John Fontanoza 

Beatrice Goode 
Cora Johnson 
Maxine Martin 

Barbara Masoa 
Salley Miller 
Judith Spellman 
Phyllis Wilson . 

Fabiola Aguirre 
Gladys Brovm 
Mary Lou Hollov/ay 
Linda Robinson 

Lillian Jorjes 

Rodolfo Alverez 
Lynetta Sue Banks 
Robi Cecchettini 

Dorothy Rreen 
Charles, Hayes 
fticardo Muratorio 
Thomas Sullivan 

Angel 0 Alonzo 
Marvin &aker 
Aureo Belasco . 



PAYROLL 
NUMBER 



JOB TITLE 



ARE 



ANNUAL 
SALARY 



SEX 



18i642 
33072 
27001 

27924 
31624 
25429 

• 24910 
23727 
16411 

20683 
10442 
10076 

34109 
10837 
22813 
21609 

35353 
42110*- 
-16G44 ■ 
30031 

21100 

19614 
26400 
21709 

30426 
19798 
21629 
27381 

t 

37883 
17009 
35620 



Accounting Clerk- 
Accountlpg Clerk ' 
Accounting Clerk 

Accounting Clerk 
Accounting Clerk 
Accounting Clerk 

Typist 
Typist 
Typist 

Typist 
Typist . 
Typist . , 

Typist 
Typist 
Typist 
- Typist 

Stenographer 
Stenographer ■ ^' 

• Stenographer 
Stenographer 

• Payroll Clerk 



Accountant 
Accountant 
Accountant 

Accountant 
Accountant 
Accountant 
Accountant 



Accounting Supdrvisor 
Accounting Supervisor 
Recounting Supervisor 



22 
41 
24 

24 
20 
19 

22 
23- 
26 

22 
21 
34 

37 
26 
32 
29 

26 
26 
34 
28 

28 

51 
30 
36 

24 
27 
30 
29 



•29 ■ 

28 

30 



' $6,080 
$6,360 ^ 
$6,360 

$6,260 

$6,100<^ 

$5,960. 

$6,620 
$6,500 
<;6,740' 

$6 ,260 
^6,440 
$6,230 

$7',000 
$6,530 
■$6,620 •. 
$6,590. 

$6,720 , 
$6 ,600 
$6,600 
$6,440 

'56,440 , 

$7,600 
$7,300 
$6,800 

$6,740 
$7,600 
$7,400 
$7,000 

$7,640 
$7,620 

$8, '200 



F 

•M 
M 

F 

F 
F 

F 

M 



MONTiiS 

OF 
-SERVICE 



11 
10 
12 

19 
7 

8 

14 
21 

33 



F 


14 


t 
r 


10 


c 

r . 


07 
CI 


F 


"46 


F 


22 


F ' 


« 40 


F 


37 






\x ■ 


' 37 


F 


• 38 


F 


•38 


F 


5 


F 


18 


n 


4 


F 


. 34 


fl 


. - 9 


F 


28 




.49 




62 




■ 1 


fl 


14 


M 


42 


'M 


•53 



ERIC 



148 
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nformatlon Worksheet 



Name: 



Identification Number; 




EXAflPLES 



' 1 



Example What is Mr. Hall's first name? \ 1- 

Example 2. How many stenographers are in the Accounting , , 
■ Department? 
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. ^ LOCATING INFORMATIQN 
!• How many men in the Department are over 45 years old? ^ I 



Z. How many merj are in the whole Accounting Department? 

3, How many persons have been in the Department. more 
^ than two yeairs? ^ 

4. What is the total months of service for all the 
Stenographers in the Department? 

5, How many employees have been in the service 
more than 18 months and earn less than $6,500? 

6. Thelma Hayes, Accounting Glerk, and Charles HayeyT 
Accountant, are married. How much do they earn 
each year ^together? 

7 J What is the average annual pay of the Accounting. 
Supervisors? 

8. What is the monthly pay of the Stenographer 
Fabiola Aquirre? 

9. What is the average age of the Accounting Clerks? 

10. How many men earn mor-e than $600 £er month as- 
Accountants? 

n. How many male Stenographers are more than 30 years 
old? 

12. How many male Accountants earn more than the 
highest- paid female Accountant? 

13. What is the difference in annual salary between* the 
highest-paid and the lowest-pj||d Typist? 

14^ What is the average months of service of female 
•* Stenographers? 

15. 'What Is the total months of service of all male 
Accountants? 



3. 



4. 



5. 



7. 

10. _ 

11. _ 

-12., _ 

13. _ 

14. _ 
15. 



Have you ever bad a job pn which. yoU were paid 
for doing a task anything .like this task? 

Yes * No 
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for doing a task very .much like this one? 



□ 
Yes 



□ 
No 



r ■ 



Name 



4 



10/17/74 



, CALCULATItlG POSTAGE CHARGES 



Identification Number 



Kind of mail 
first class letter' 
'single post card 
double post card 
air mail letter 



POSTAGE RATES 

Cost per ounce or per piece 
$ .10 per ounce ' 
^ ^ $ .08 each 
$ .16 each 
$ .13 per. ounce 



Additional fees 

special delivery' 
{spec del) -60^ 

certified mail 

(cert) .30^ 



Kind of mail , ' 

MAY'S MAIL 

first class letter* 
air mail letter 
double post card (spec del) 
• single post card(cert) ' ' 

TUESDAY'S wkv 



Weight 
per piece 



2 ounces 

3 ounces 



Cost per 
piece 



s .39 



[lumber 
of pieces 



2 
1 

10 
5 



Cost 



Total cost of flonday's mail = $ / 0.2^^ 



' air mail letter 


2 


ounces 


$ 


» 


3 


% 


first class letter (spec. del) , 


1 


ounce 


$ 




8 


$ 


first class letter (cert) 


4 


ourjces 


% 


t 


4 ^ 


$ 


double post card 






% 


♦ 


2 


$ 








Total cost of Tuesday's mail = 


$ 


WEDNESDAY'S MAIL 














air mail (cert) 


2 


ounces 


$ 


— » 


6 


$ 


air mail' letter 


1 


ounce 


$ 


t 


4 


$ 


first class letter 


' 3 


ounces 


$ 


• 


2 


$ 


single post card y 








— — t — 


10 


$ 


first class letj^r (spec ^) 


2. 
1^ 


ounces 


$ 


1 


3 


$ 








Total cost of Wednesday's mail= 


$ 


THURSDAY'S HAIL 














first class letter (cert) ' 


4 


ounces 


"\ 


J 


7 


:$ 


double post card 






' % 


i 
• 


15 • • 


.$ 


first class letter 


1 


ounce. 


% 


* 


8 •• 


$ 


' air mail letter 


4 


ounces 


% 


. f 


. . 6 - 


$ 


* air mail 'letter (spec del) ' 


' 3 


ounces 


% 


• 


• 4- • ■ 


$ 
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first class letter $ .19 per ounce 
single po st card / $ .09 each 



RATES 

•double po^t card $ .;L6 each 
air mail letter $ .13 per ounce 



spec del 
cert mail 



$ .60 
$ .30 



Kind of mail 

FRIDAY'S MAIL ' ' 

air mail letter (spec defl) 
. doubl e post card 

first class letter 
^ aif mail letter 
first class letter (cert), 
first class letter 

WNDAy'S MAIL . " . 

first class letter (spec del) 
single post card 
air mail letter 
first class letter (cert) 
air mail letter 
air mail letter 

TUESDAY'S MAIL 
double post card 
air mail letter 
first class letter 
air mail letter (spec) 
air mail letter 
double post card (spec del) 



Weight 
per piece 



2 ounces 

3 6ut>ees 
5 ounces 

2 ounces 

3 ounces- 



4 ounces 

3 ounces 
2 ounces 
1 ounce 

5 ounces 



5 ounces 
3 ounces 

1 ounce 

2 ounces. 



Cast Pier 
piece 



$_ 
$_ 

"$_ 
$_ 
$ 



flumber 
of pieces 



2 

13 
24 
11 
3 

13 



$. 
$. 
$. 
$. 
$. 
$ 



4 

19 
18 

7 

14 
17 



•$. 
$ 



$. 

$ 



11 

7 
9 
6 
15 
9 



Cost 



$. 
$. 



Total cost of Friday's mail' = $ 



$. 
$_ 
$_ 
$. 
$_ 
$ 



Total cost of Monday's mail = $ 



$. 

$. 
$_ 
$ 



Total cost of Tuesday's mail = $ 



Have you ever had a job on which you v/ere paid 
for doing a task anything like this task? 



far doing a task very much like this" one? 



□ Yes □ No 



D Yes □ Wp-- 



-6 
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• SPECIAL SCORING INSTRUCTIONS FOR CRM'S 

The following instructions were provided to scorers' and checkers 'for' 
the CRM's: 

Che<:king Applications 

.1. Put a line through each number that is not circled as required, A1so > 
put a line through any ntimber that is circled but should not be circled. 

2. A coinnon error that the examinees make occurs on the- back side at tne 
top. They incorrectly record on the top line the ^2 and 13 that are 
the answers for the second item. This v/ould appear to be 4 errors, 
according to the scoring system. However, count it only as two^ errors. 

Compari ng -Addresses 
1. If both S and D-are checked for one item, the answer is incorrect. 



Comparing Telephone Information 
1. If both S and 0 are checkeid for the same item, the arisv/er is incorrect* 

Copying Telephone Information • • * 

1. If 3 or 4 of the last four digits of the telephone nupter are wrong, 
count it as 7 errors. The examinee has prdbably copied the wrong line, 
and may have gotten the exchange numbers (the first 3 digits) and possibly 
1 of the last 4 digits correct by accident. ^ 

2. If the wrong ^street has bee? copied, the number of errors is the nunfeer 
of characters (digits and letters) in the correct address (not the number 
of characters in the v/rong street that has been inserted). 

3. Inltia.1 Caps in the address must appear as irii-tial caps, and not as 
small 'letters. However, rem^mtjer that people write differently.- For 
example, either 6^>^»'J^^y A^^^-^y^-- ^ hJ ^ ex. 

would bfe correct. . , , 

4. 'Either extra Characters or mi^ssing characters in'the address are incorrect. 

5. Spacing of the address doesn't matter. ' v . , 



•»/ ' ' ^ Classifying AppHahce Dealers 

1. Count the number of cards missing from each classification. Also 
write In the numt^ers of the carjcls missing at the bottom of the column. 

' ' . , This Win make the card number easier to find when you are scoring 

alphabetizing. ^ 

2. Circle, but do not count as Incorrect^ any extra numbers fn the 
category. 

^* If one card Is completely missing, do not count It as an' error. , 

(This Is profe/bly the test administrator's recording error). However, 
. If the cards missing are high numbers, e.g., 58, 57 and 58, or'56, 
57 and 58, count these cards as "not attempted", and subtract these 
cards not attempted from 58. . ; . • 

Alphabetizing Appliance. Dealers \ 

1. ' If. It's obvious there was no attempt to alphabetize, post QO ^o&^H 
• score and for the number attempted' on the BpS. 

2. After classification scoring has b6en completed, treat all card 
•numbers as In correct classification. You will "have to ^Ind the 
first letters of the card numbers ypu have circled using the special 
alphabetizing icey. Then check to see If they were filed 1n correct 

' ■ alphabetical order within the category. 

3. If all classification In a category Is correct, there Is no need 
to use the special alphabetizing key. Just mark with an arrow how 
tf\e alphabetizing errors can.be corrected. 

. ' 4. Post classification errors on the left side of each category column. . 

Post alphabetizing errcTrS on the right side of each category column. 

5. The total posslbl-e- number of errors in any one of the 8 categories 
i.s3. ^ ■ ' • • 

Score 1 error. If only one card ntmiber needs to be moved to have 
/ . correct order. . , 

Score 2 errors If 2 card numbers have to be moved to have correct 
order. 

Score 3 errors If more than 2 card numbers have tjo b6. moved to' have 
correct order. . . , i 

ERJC ... ' . , 15i 



6.. The total possible number of aljjhabetizlng errors /is equa^ to 24 
(3 errors In each category). Subtract the tot^l /4rrors/from 58 orj 
. from the number attempted to obtairt the aJpWabel 

The scoring of the alphabetization tpk-proi/a^ 

ficult. First administrators v^ere askeo to,recc(T^ 

filed. They made some errors |n.this recordin/ tWt 
^^^^^.^.^Ssmij^jgn of cards. Other^ may hde ocoxfrpL, ^ 

some of the s^ple recorded thfe orderZ/of cards 'wnicji/ 

the^e persons made copying eri^rs (n«t knoif ^'-^ ' 
. was improperly reduced. In ^ditior/th'e ^uniing.df 

two cards out of order becomefe very compiexJ For thi 
, directed not to try to untangle the' web of y4rrors < 

administration it is suggesWd thaji somEf ofther method/df fonstruct.i 

output be utilized that would penjiit^in/ler scorflng^ 



1. If year appears as 19501, 19 
it as incorrect.,. 



not correytt'. , 




2. Qode for H5, 6S, and COL n^st/he correct* , pat 
as College^ Doubje triple answers, as HS 



3. If only W & F aftpearl 

colunn are i^cofrecjftC^ Th.is indicates th^7examinee 
rather than mai/itat /statys. ' ^ ' J / 

copying Hotisi 

Score. on Copying is th% number right fn.OTluinns headed /Numbe^t* 
tn Family" §ind "Total llonthly Family Iricpi 



Classifying Housing Qualifications 

Score on Classifying is the number right on the two subsequent columns to 
the right. Deviations frohi the key were permitted as follows: 

- If the data copied 1n the first two colurtiis a^^ inco'rretct, the/ 
answers in the subseqgent columns are evalua'ted in terms of using the 
v/rong data rather thaih the scoifing key. Thus a copying, error does not 
affect/ the classify^tig score. 



/ 




Lf^lhe. worker ^incorrectly records that the given family is no£ 
quayii^ied for low/rent housing, fn the subsequent column only the answer 
"Npn^'/is counted^ correct. 

/ / Locating and Classifying Zip Cbdes 

/ / ' ' ' . 

'f t^^ examinee gets off the correct line, by omitting one number, (the 

\ieH are correct when you move the key up ok rfov/n one line) do not 

■ounc these answers incorrect. Just count one error. 



Locating Personnel Information 

po not couiVt ijt incorrect if a .dollar sign has been omitted. Count -as 
correct if aipier the v;ord or number is given, e.g. 2 or two. 

Calculating -Postage Charges 

K If ther^ is an error in the cost per piece, then check the multiplication 
and the addition in the next column, by doing them yourself. If the 
calculations are correct, treat them as correct even though the answers 
do not agree with the key* 

2* If there is no error in the cost per piece; then score the multiplication 
only/ according to this scoring key. 

3. If there is a multiplication error, check the addition by doing it yourself* 
If correct, treat the answer as correct even though it dotfs not agree with 
the^ scoring key* 



1c: 



If the answer for cost per piece is .08, count .8, •-8, and 8- as correct. 
However .do not count .80 or 8.00 as correct. This means, that as long as 
there is n o zero after the 8, the answer is correct. 

If the cost per piece is missing, but the multiplication is correct, do 
not mark the cost per piece as an error. 

If the decimal is not, exactly in the proper place in the "cost per piece" 
•column, do not count this as. an error. However, the decimal must be 
correct in the multiplication and the addition columns. 

Check to see if numbers in the "number of pieces" column have been 
changed from those on the "Cost" scoring keys. If they have, the key 
will be incorrect and you will have to do the multiplying to determine 
if the answer is correct. 
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BACKGROUND INFORMATION 



NAME 



Identification Number 



Which qroup best describes you? . Check (X) one. 



O 

n 
□ 
□ 
□ 
□ 



1. 

2. 
3. 
4. 



5. 



Neqro 

American Indian ' ' 

White (Caucasian) 

Soanish-speakinn (Cuban, Mexican, Puerto-Rtcan, etc.) 
Oriental 

Other (snecifv ; . ; • ) 



Sex 



□ Male 
Female 



Birthdate 
Education 

□ .1 

□ 2 

• •□ 3 

□ '4 



Month Year, 

What is the hiqhest. school orade you completed? 
Check (X) one. 

0 

□ 



Q 
□ 
□ 
□ 



5 
6 

7 
.8 
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